May 28 16:03:01.401395 ip-10-0-134-197 systemd[1]: Starting Kubernetes Kubelet... May 28 16:03:01.840433 ip-10-0-134-197 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 16:03:01.840433 ip-10-0-134-197 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 16:03:01.840433 ip-10-0-134-197 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 16:03:01.840433 ip-10-0-134-197 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 16:03:01.840433 ip-10-0-134-197 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 16:03:01.842235 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.842143 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 16:03:01.845769 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845750 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:03:01.845769 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845768 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845773 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845777 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845780 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845783 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845787 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845790 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845793 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845796 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845799 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845801 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845804 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845807 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845810 2573 feature_gate.go:328] unrecognized feature gate: Example May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845813 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845815 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845818 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845821 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845823 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:03:01.845836 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845826 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845829 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845831 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845834 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845836 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845839 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845843 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845845 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845848 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845852 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845854 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845857 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845860 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845862 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845865 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845867 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845870 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845872 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845875 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845878 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:03:01.846310 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845880 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845883 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845885 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845887 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845890 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845893 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845896 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845898 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845901 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845903 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845907 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845911 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845913 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845916 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845919 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845922 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845924 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845928 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845930 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845933 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:03:01.846824 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845935 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845938 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845941 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845944 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845947 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845949 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845952 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845954 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845958 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845960 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845963 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845965 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845968 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845970 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845973 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845975 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845978 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845980 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845983 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845986 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:03:01.847371 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845988 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845991 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845993 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.845997 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846001 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846004 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846444 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846449 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846452 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846456 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846459 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846461 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846464 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846467 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846470 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846472 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846475 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846478 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846481 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:03:01.847858 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846483 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846486 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846488 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846491 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846493 2573 feature_gate.go:328] unrecognized feature gate: Example May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846496 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846499 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846502 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846504 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846506 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846509 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846511 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846514 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846517 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846519 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846522 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846524 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846526 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846529 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846533 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:03:01.848379 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846536 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846539 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846542 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846545 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846548 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846551 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846554 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846557 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846559 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846562 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846565 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846568 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846570 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846573 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846575 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846579 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846583 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846585 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846588 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:03:01.848879 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846591 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846594 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846597 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846599 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846602 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846604 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846607 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846609 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846612 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846614 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846617 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846619 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846623 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846626 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846628 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846631 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846634 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846636 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846639 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846642 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:03:01.849397 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846644 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846646 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846649 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846653 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846655 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846658 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846660 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846663 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846665 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846668 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846670 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846672 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846675 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.846677 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.847818 2573 flags.go:64] FLAG: --address="0.0.0.0" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.847829 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848347 2573 flags.go:64] FLAG: --anonymous-auth="true" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848353 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848358 2573 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848362 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848378 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 16:03:01.849889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848384 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848387 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848391 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848395 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848399 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848402 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848406 2573 flags.go:64] FLAG: --cgroup-root="" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848409 2573 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848412 2573 flags.go:64] FLAG: --client-ca-file="" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848415 2573 flags.go:64] FLAG: --cloud-config="" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848418 2573 flags.go:64] FLAG: --cloud-provider="external" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848421 2573 flags.go:64] FLAG: --cluster-dns="[]" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848425 2573 flags.go:64] FLAG: --cluster-domain="" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848428 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848432 2573 flags.go:64] FLAG: --config-dir="" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848435 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848439 2573 flags.go:64] FLAG: --container-log-max-files="5" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848443 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848446 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848450 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848453 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848456 2573 flags.go:64] FLAG: --contention-profiling="false" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848459 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848462 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848465 2573 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 16:03:01.850411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848469 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848474 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848477 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848480 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848483 2573 flags.go:64] FLAG: --enable-load-reader="false" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848486 2573 flags.go:64] FLAG: --enable-server="true" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848489 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848494 2573 flags.go:64] FLAG: --event-burst="100" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848498 2573 flags.go:64] FLAG: --event-qps="50" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848500 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848504 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848507 2573 flags.go:64] FLAG: --eviction-hard="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848511 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848514 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848517 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848521 2573 flags.go:64] FLAG: --eviction-soft="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848524 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848527 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848530 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848533 2573 flags.go:64] FLAG: --experimental-mounter-path="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848536 2573 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848538 2573 flags.go:64] FLAG: --fail-swap-on="true" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848542 2573 flags.go:64] FLAG: --feature-gates="" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848546 2573 flags.go:64] FLAG: --file-check-frequency="20s" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848549 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 16:03:01.851041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848552 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848555 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848559 2573 flags.go:64] FLAG: --healthz-port="10248" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848562 2573 flags.go:64] FLAG: --help="false" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848565 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-134-197.ec2.internal" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848569 2573 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848572 2573 flags.go:64] FLAG: --http-check-frequency="20s" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848576 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848579 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848583 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848586 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848589 2573 flags.go:64] FLAG: --image-service-endpoint="" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848592 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848595 2573 flags.go:64] FLAG: --kube-api-burst="100" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848598 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848601 2573 flags.go:64] FLAG: --kube-api-qps="50" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848604 2573 flags.go:64] FLAG: --kube-reserved="" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848607 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848610 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848613 2573 flags.go:64] FLAG: --kubelet-cgroups="" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848616 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848619 2573 flags.go:64] FLAG: --lock-file="" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848622 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848625 2573 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 16:03:01.851674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848628 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848633 2573 flags.go:64] FLAG: --log-json-split-stream="false" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848637 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848640 2573 flags.go:64] FLAG: --log-text-split-stream="false" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848642 2573 flags.go:64] FLAG: --logging-format="text" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848645 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848650 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848653 2573 flags.go:64] FLAG: --manifest-url="" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848656 2573 flags.go:64] FLAG: --manifest-url-header="" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848661 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848664 2573 flags.go:64] FLAG: --max-open-files="1000000" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848668 2573 flags.go:64] FLAG: --max-pods="110" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848671 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848674 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848677 2573 flags.go:64] FLAG: --memory-manager-policy="None" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848681 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848684 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848687 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848691 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848699 2573 flags.go:64] FLAG: --node-status-max-images="50" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848702 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848705 2573 flags.go:64] FLAG: --oom-score-adj="-999" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848708 2573 flags.go:64] FLAG: --pod-cidr="" May 28 16:03:01.852262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848711 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848717 2573 flags.go:64] FLAG: --pod-manifest-path="" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848721 2573 flags.go:64] FLAG: --pod-max-pids="-1" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848724 2573 flags.go:64] FLAG: --pods-per-core="0" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848727 2573 flags.go:64] FLAG: --port="10250" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848730 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848733 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-040fe2fca34307393" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848737 2573 flags.go:64] FLAG: --qos-reserved="" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848739 2573 flags.go:64] FLAG: --read-only-port="10255" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848742 2573 flags.go:64] FLAG: --register-node="true" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848745 2573 flags.go:64] FLAG: --register-schedulable="true" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848748 2573 flags.go:64] FLAG: --register-with-taints="" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848752 2573 flags.go:64] FLAG: --registry-burst="10" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848755 2573 flags.go:64] FLAG: --registry-qps="5" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848758 2573 flags.go:64] FLAG: --reserved-cpus="" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848761 2573 flags.go:64] FLAG: --reserved-memory="" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848766 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848769 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848772 2573 flags.go:64] FLAG: --rotate-certificates="false" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848775 2573 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848778 2573 flags.go:64] FLAG: --runonce="false" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848781 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848784 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848792 2573 flags.go:64] FLAG: --seccomp-default="false" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848795 2573 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848798 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 16:03:01.852835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848801 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848804 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848807 2573 flags.go:64] FLAG: --storage-driver-password="root" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848810 2573 flags.go:64] FLAG: --storage-driver-secure="false" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848813 2573 flags.go:64] FLAG: --storage-driver-table="stats" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848816 2573 flags.go:64] FLAG: --storage-driver-user="root" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848819 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848822 2573 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848825 2573 flags.go:64] FLAG: --system-cgroups="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848828 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848834 2573 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848837 2573 flags.go:64] FLAG: --tls-cert-file="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848840 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848844 2573 flags.go:64] FLAG: --tls-min-version="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848847 2573 flags.go:64] FLAG: --tls-private-key-file="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848850 2573 flags.go:64] FLAG: --topology-manager-policy="none" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848853 2573 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848855 2573 flags.go:64] FLAG: --topology-manager-scope="container" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848858 2573 flags.go:64] FLAG: --v="2" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848863 2573 flags.go:64] FLAG: --version="false" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848867 2573 flags.go:64] FLAG: --vmodule="" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848872 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.848875 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.848981 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:03:01.853471 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.848986 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.848989 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.848993 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.848996 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.848999 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849004 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849006 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849009 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849012 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849015 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849018 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849021 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849024 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849026 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849029 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849032 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849035 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849037 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849040 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849042 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:03:01.854036 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849045 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849048 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849050 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849052 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849055 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849058 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849061 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849063 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849066 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849068 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849071 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849073 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849077 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849079 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849082 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849084 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849087 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849102 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849106 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:03:01.854593 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849108 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849111 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849114 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849117 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849119 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849122 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849125 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849129 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849132 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849135 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849138 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849141 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849144 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849147 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849149 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849152 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849154 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849157 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849160 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:03:01.855317 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849162 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849165 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849168 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849171 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849173 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849176 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849178 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849182 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849184 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849187 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849190 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849193 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849196 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849199 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849201 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849204 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849206 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849209 2573 feature_gate.go:328] unrecognized feature gate: Example May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849212 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849214 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849217 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:03:01.855977 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849219 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:03:01.856569 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849224 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:03:01.856569 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849227 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:03:01.856569 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849229 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:03:01.856569 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849232 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:03:01.856569 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.849235 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:03:01.856569 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.849240 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 16:03:01.857327 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.857205 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 16:03:01.857365 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.857327 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 16:03:01.857398 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857389 2573 feature_gate.go:328] unrecognized feature gate: Example May 28 16:03:01.857398 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857394 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:03:01.857398 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857398 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857402 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857405 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857408 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857411 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857414 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857417 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857420 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857422 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857425 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857428 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857430 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857433 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857436 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857439 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857441 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857444 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857446 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857449 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857452 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:03:01.857476 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857455 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857457 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857460 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857463 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857466 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857468 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857472 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857474 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857477 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857480 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857484 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857487 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857490 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857492 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857495 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857498 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857500 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857503 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857506 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857508 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:03:01.857971 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857511 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857514 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857516 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857519 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857522 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857524 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857527 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857529 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857532 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857535 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857537 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857541 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857545 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857549 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857552 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857555 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857558 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857560 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857563 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:03:01.858482 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857567 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857572 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857575 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857578 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857582 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857585 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857588 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857591 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857594 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857597 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857600 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857602 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857605 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857608 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857610 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857614 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857616 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857619 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857622 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857624 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:03:01.858949 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857627 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857630 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857632 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857636 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857638 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.857643 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857761 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857767 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857770 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857773 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857776 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857780 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857782 2573 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857786 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857788 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857791 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 16:03:01.859474 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857794 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857796 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857799 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857801 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857804 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857806 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857809 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857811 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857814 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857816 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857820 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857825 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857828 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857831 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857833 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857836 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857839 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857841 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857844 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857846 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 16:03:01.859874 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857849 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857851 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857854 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857858 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857861 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857863 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857866 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857868 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857871 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857874 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857876 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857879 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857881 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857884 2573 feature_gate.go:328] unrecognized feature gate: Example2 May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857886 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857889 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857891 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857894 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857898 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 16:03:01.860383 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857901 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857904 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857907 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857910 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857912 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857915 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857918 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857920 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857923 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857926 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857928 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857931 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857934 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857936 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857939 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857941 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857944 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857947 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857949 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857952 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 16:03:01.860842 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857955 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857957 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857960 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857962 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857965 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857967 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857970 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857972 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857975 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857978 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857981 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857984 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857987 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857989 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857992 2573 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857994 2573 feature_gate.go:328] unrecognized feature gate: Example May 28 16:03:01.861436 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:01.857997 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 16:03:01.861823 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.858002 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 16:03:01.861823 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.859712 2573 server.go:962] "Client rotation is on, will bootstrap in background" May 28 16:03:01.863606 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.863591 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 16:03:01.864666 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.864655 2573 server.go:1019] "Starting client certificate rotation" May 28 16:03:01.864852 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.864833 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 16:03:01.864885 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.864878 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 16:03:01.888722 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.888695 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 16:03:01.890816 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.890796 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 16:03:01.901187 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.901071 2573 log.go:25] "Validated CRI v1 runtime API" May 28 16:03:01.906607 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.906585 2573 log.go:25] "Validated CRI v1 image API" May 28 16:03:01.908543 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.908523 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 16:03:01.911691 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.911669 2573 fs.go:135] Filesystem UUIDs: map[425c72a6-c461-4233-a3cb-8e855a90a865:/dev/nvme0n1p4 4b6066aa-cdd7-4d61-8b44-8ab04b5d9e24:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 28 16:03:01.911762 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.911691 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 16:03:01.915969 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.915857 2573 manager.go:217] Machine: {Timestamp:2026-05-28 16:03:01.915354729 +0000 UTC m=+0.397877610 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117663 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec248a18e240b430b3543c7b5578abd2 SystemUUID:ec248a18-e240-b430-b354-3c7b5578abd2 BootID:5a072ec2-f14d-48f6-bc9f-3d9133a41851 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:a0:6b:6f:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:a0:6b:6f:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:91:b6:c8:84:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 16:03:01.916722 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.916709 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 16:03:01.916876 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.916863 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 16:03:01.919382 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.919362 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 16:03:01.919754 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.919729 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 16:03:01.919899 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.919760 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 16:03:01.919944 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.919910 2573 topology_manager.go:138] "Creating topology manager with none policy" May 28 16:03:01.919944 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.919919 2573 container_manager_linux.go:306] "Creating device plugin manager" May 28 16:03:01.919944 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.919927 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 16:03:01.920844 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.920833 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 16:03:01.921974 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.921960 2573 state_mem.go:36] "Initialized new in-memory state store" May 28 16:03:01.922111 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.922088 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 16:03:01.924505 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.924493 2573 kubelet.go:491] "Attempting to sync node with API server" May 28 16:03:01.924545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.924510 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 16:03:01.924545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.924522 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 16:03:01.924545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.924533 2573 kubelet.go:397] "Adding apiserver pod source" May 28 16:03:01.924545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.924542 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 16:03:01.925590 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.925575 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 16:03:01.925624 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.925604 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 16:03:01.928725 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.928703 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 16:03:01.930646 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.930631 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 16:03:01.932498 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932486 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932503 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932509 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932515 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932524 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932530 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932535 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932541 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 16:03:01.932546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932550 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 16:03:01.932755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932556 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 16:03:01.932755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932575 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 16:03:01.932755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.932581 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 16:03:01.933300 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.933290 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 16:03:01.933300 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.933300 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 16:03:01.936547 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.936531 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 16:03:01.936627 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.936569 2573 server.go:1295] "Started kubelet" May 28 16:03:01.936688 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.936629 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 16:03:01.936734 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.936694 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 16:03:01.936779 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.936757 2573 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 16:03:01.937478 ip-10-0-134-197 systemd[1]: Started Kubernetes Kubelet. May 28 16:03:01.938186 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.937597 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 16:03:01.938186 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.937762 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:01.938186 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.937816 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 16:03:01.938186 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.937845 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 16:03:01.939366 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.939348 2573 server.go:317] "Adding debug handlers to kubelet server" May 28 16:03:01.945924 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.944543 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec6245bfb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.936544763 +0000 UTC m=+0.419067644,LastTimestamp:2026-05-28 16:03:01.936544763 +0000 UTC m=+0.419067644,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:01.946420 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.946403 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 16:03:01.946848 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.946828 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 16:03:01.946975 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.946947 2573 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 16:03:01.947023 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.946981 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 16:03:01.947130 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.947115 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 16:03:01.947241 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.947196 2573 reconstruct.go:97] "Volume reconstruction finished" May 28 16:03:01.947241 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.947204 2573 reconciler.go:26] "Reconciler: start to sync state" May 28 16:03:01.947346 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.947327 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 16:03:01.947701 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.947674 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-197.ec2.internal\" not found" May 28 16:03:01.947947 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.947930 2573 factory.go:153] Registering CRI-O factory May 28 16:03:01.947947 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.947948 2573 factory.go:223] Registration of the crio container factory successfully May 28 16:03:01.948058 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.947999 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 16:03:01.948058 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.948007 2573 factory.go:55] Registering systemd factory May 28 16:03:01.948058 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.948012 2573 factory.go:223] Registration of the systemd container factory successfully May 28 16:03:01.948058 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.948026 2573 factory.go:103] Registering Raw factory May 28 16:03:01.948058 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.948041 2573 manager.go:1196] Started watching for new ooms in manager May 28 16:03:01.948660 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.948525 2573 manager.go:319] Starting recovery of all containers May 28 16:03:01.948844 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.948661 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 16:03:01.948844 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.948794 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 28 16:03:01.956258 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.956228 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pfjm8" May 28 16:03:01.959073 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.959057 2573 manager.go:324] Recovery completed May 28 16:03:01.963393 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.963378 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:01.965689 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.965666 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:01.965786 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.965712 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:01.965786 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.965730 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:01.966724 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.966695 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 16:03:01.966724 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.966711 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 16:03:01.966851 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.966732 2573 state_mem.go:36] "Initialized new in-memory state store" May 28 16:03:01.969127 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.969113 2573 policy_none.go:49] "None policy: Start" May 28 16:03:01.969185 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.969131 2573 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 16:03:01.969185 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:01.969142 2573 state_mem.go:35] "Initializing new in-memory state store" May 28 16:03:01.976881 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.976810 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:01.987426 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.987334 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:01.999284 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:01.999132 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.009717 2573 manager.go:341] "Starting Device Plugin manager" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.009749 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.009759 2573 server.go:85] "Starting device plugin registration server" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.010053 2573 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.010066 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.010200 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.010288 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.010318 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.011238 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 16:03:02.017819 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.011272 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-197.ec2.internal\" not found" May 28 16:03:02.024142 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.024059 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ecabb2cdc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:02.0135375 +0000 UTC m=+0.496060372,LastTimestamp:2026-05-28 16:03:02.0135375 +0000 UTC m=+0.496060372,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.077021 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.076966 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 16:03:02.078279 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.078263 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 16:03:02.078384 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.078295 2573 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 16:03:02.078384 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.078319 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 16:03:02.078384 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.078328 2573 kubelet.go:2451] "Starting kubelet main sync loop" May 28 16:03:02.078499 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.078433 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 16:03:02.087400 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.087370 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" May 28 16:03:02.110653 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.110606 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.111509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.111492 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.111601 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.111521 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.111601 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.111530 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.111601 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.111553 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.120816 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.120739 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.11150828 +0000 UTC m=+0.594031160,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.123015 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.122945 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.111525716 +0000 UTC m=+0.594048598,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.123111 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.123074 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.129365 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.129307 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:02.111534731 +0000 UTC m=+0.594057612,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.151385 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.151362 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" May 28 16:03:02.178546 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.178519 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal"] May 28 16:03:02.178635 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.178595 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.180342 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.180323 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.180461 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.180351 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.180461 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.180363 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.181446 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.181431 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.181600 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.181583 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.181663 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.181621 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.182138 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.182123 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.182138 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.182134 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.182268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.182144 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.182268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.182154 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.182268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.182157 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.182268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.182171 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.183954 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.183938 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" May 28 16:03:02.184035 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.183967 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.184788 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.184772 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.184856 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.184797 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.184856 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.184809 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.189250 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.189181 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.180338171 +0000 UTC m=+0.662861052,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.200438 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.200360 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.180356129 +0000 UTC m=+0.662879010,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.210191 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.210127 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:02.180375439 +0000 UTC m=+0.662898323,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.214870 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.214852 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.218663 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.218600 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.182135712 +0000 UTC m=+0.664658593,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.219297 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.219283 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.227908 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.227851 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.182149095 +0000 UTC m=+0.664671976,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.236252 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.236184 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.182147004 +0000 UTC m=+0.664669890,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.248521 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.248452 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:02.182157912 +0000 UTC m=+0.664680794,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.248762 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.248730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ae5e75a733961f8d5a9aefe5c4d68d1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal\" (UID: \"6ae5e75a733961f8d5a9aefe5c4d68d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.248870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.248836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ae5e75a733961f8d5a9aefe5c4d68d1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal\" (UID: \"6ae5e75a733961f8d5a9aefe5c4d68d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.248870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.248863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcf920ea05c3c7ff41d5c3afce1571e9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-197.ec2.internal\" (UID: \"fcf920ea05c3c7ff41d5c3afce1571e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" May 28 16:03:02.258313 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.258247 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.182163413 +0000 UTC m=+0.664686298,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.268156 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.268075 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:02.182176823 +0000 UTC m=+0.664699705,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.279571 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.279511 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.184788525 +0000 UTC m=+0.667311406,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.289647 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.289589 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.184802212 +0000 UTC m=+0.667325092,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.298219 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.298162 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:02.184814825 +0000 UTC m=+0.667337710,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.323281 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.323261 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.324037 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.324013 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.324037 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.324035 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.324166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.324046 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.324166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.324075 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.333150 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.333046 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.324026186 +0000 UTC m=+0.806549066,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.341320 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.341251 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.324039598 +0000 UTC m=+0.806562478,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.341422 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.341405 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.349280 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.349258 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcf920ea05c3c7ff41d5c3afce1571e9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-197.ec2.internal\" (UID: \"fcf920ea05c3c7ff41d5c3afce1571e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" May 28 16:03:02.349363 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.349290 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ae5e75a733961f8d5a9aefe5c4d68d1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal\" (UID: \"6ae5e75a733961f8d5a9aefe5c4d68d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.349363 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.349317 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ae5e75a733961f8d5a9aefe5c4d68d1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal\" (UID: \"6ae5e75a733961f8d5a9aefe5c4d68d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.349363 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.349243 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e1bf34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965733684 +0000 UTC m=+0.448256565,LastTimestamp:2026-05-28 16:03:02.324049783 +0000 UTC m=+0.806572663,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.349363 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.349338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcf920ea05c3c7ff41d5c3afce1571e9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-197.ec2.internal\" (UID: \"fcf920ea05c3c7ff41d5c3afce1571e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" May 28 16:03:02.349518 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.349364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ae5e75a733961f8d5a9aefe5c4d68d1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal\" (UID: \"6ae5e75a733961f8d5a9aefe5c4d68d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.349518 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.349338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ae5e75a733961f8d5a9aefe5c4d68d1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal\" (UID: \"6ae5e75a733961f8d5a9aefe5c4d68d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.518186 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.518079 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:02.521949 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.521928 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" May 28 16:03:02.559865 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.559829 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" May 28 16:03:02.742471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.742437 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:02.744894 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.744873 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:02.744999 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.744913 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:02.744999 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.744927 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:02.744999 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.744954 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.754611 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.754530 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e10b0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965687565 +0000 UTC m=+0.448210452,LastTimestamp:2026-05-28 16:03:02.744894224 +0000 UTC m=+1.227417114,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.762654 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.762631 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:02.762745 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.762679 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-197.ec2.internal.18b3c62ec7e18c76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-197.ec2.internal,UID:ip-10-0-134-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-197.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:01.965720694 +0000 UTC m=+0.448243574,LastTimestamp:2026-05-28 16:03:02.744920992 +0000 UTC m=+1.227443875,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:02.809674 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:02.809605 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 16:03:02.950946 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:02.950916 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:03.033675 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:03.033504 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae5e75a733961f8d5a9aefe5c4d68d1.slice/crio-3e110c821f6da5f3d516bfcd4c6043084ca109d329f0078fd49a64251ba9e374 WatchSource:0}: Error finding container 3e110c821f6da5f3d516bfcd4c6043084ca109d329f0078fd49a64251ba9e374: Status 404 returned error can't find the container with id 3e110c821f6da5f3d516bfcd4c6043084ca109d329f0078fd49a64251ba9e374 May 28 16:03:03.033938 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:03.033917 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf920ea05c3c7ff41d5c3afce1571e9.slice/crio-6e6c7d5083e189b0eb2f52a046a8fdf174f31ac59ad5b65f414d7b2653f8e64a WatchSource:0}: Error finding container 6e6c7d5083e189b0eb2f52a046a8fdf174f31ac59ad5b65f414d7b2653f8e64a: Status 404 returned error can't find the container with id 6e6c7d5083e189b0eb2f52a046a8fdf174f31ac59ad5b65f414d7b2653f8e64a May 28 16:03:03.039000 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.038872 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:03:03.047316 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.047233 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62f07dd5249 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89727a58f44fdd814af55736088579f336f2d7df57ff1a1b369b7bf7fe3bc2ec\",Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:03.039185481 +0000 UTC m=+1.521708362,LastTimestamp:2026-05-28 16:03:03.039185481 +0000 UTC m=+1.521708362,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:03.064105 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.063986 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-197.ec2.internal.18b3c62f07e11fa1 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-197.ec2.internal,UID:fcf920ea05c3c7ff41d5c3afce1571e9,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1913f8c490e59a4bce37630afd80b56d8a165ac70c8d7c3712de13acf3d3612\",Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:03.039434657 +0000 UTC m=+1.521957547,LastTimestamp:2026-05-28 16:03:03.039434657 +0000 UTC m=+1.521957547,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:03.081924 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.081884 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" event={"ID":"fcf920ea05c3c7ff41d5c3afce1571e9","Type":"ContainerStarted","Data":"6e6c7d5083e189b0eb2f52a046a8fdf174f31ac59ad5b65f414d7b2653f8e64a"} May 28 16:03:03.084562 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.084533 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" event={"ID":"6ae5e75a733961f8d5a9aefe5c4d68d1","Type":"ContainerStarted","Data":"3e110c821f6da5f3d516bfcd4c6043084ca109d329f0078fd49a64251ba9e374"} May 28 16:03:03.140276 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.140248 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 16:03:03.272700 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.272667 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" May 28 16:03:03.368702 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.368639 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" May 28 16:03:03.454533 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.454502 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 16:03:03.563257 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.563224 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:03.564348 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.564324 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:03.564467 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.564362 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:03.564467 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.564384 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:03.564467 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.564417 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:03.580774 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:03.580734 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:03.948381 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:03.948336 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:04.424758 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:04.424725 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 16:03:04.883705 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:04.883628 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62f753e35d5 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89727a58f44fdd814af55736088579f336f2d7df57ff1a1b369b7bf7fe3bc2ec\" in 1.835s (1.835s including waiting). Image size: 288020462 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:04.874251733 +0000 UTC m=+3.356774604,LastTimestamp:2026-05-28 16:03:04.874251733 +0000 UTC m=+3.356774604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:04.922740 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:04.922657 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-197.ec2.internal.18b3c62f7790f290 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-197.ec2.internal,UID:fcf920ea05c3c7ff41d5c3afce1571e9,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1913f8c490e59a4bce37630afd80b56d8a165ac70c8d7c3712de13acf3d3612\" in 1.873s (1.873s including waiting). Image size: 300190427 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:04.913228432 +0000 UTC m=+3.395751300,LastTimestamp:2026-05-28 16:03:04.913228432 +0000 UTC m=+3.395751300,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:04.946670 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:04.946644 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:04.978383 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:04.978352 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s" May 28 16:03:04.986422 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:04.986345 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-197.ec2.internal.18b3c62f7b663eb9 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-197.ec2.internal,UID:fcf920ea05c3c7ff41d5c3afce1571e9,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:04.977538745 +0000 UTC m=+3.460061634,LastTimestamp:2026-05-28 16:03:04.977538745 +0000 UTC m=+3.460061634,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:04.994324 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:04.994232 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-197.ec2.internal.18b3c62f7bc6c3c0 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-197.ec2.internal,UID:fcf920ea05c3c7ff41d5c3afce1571e9,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:04.983864256 +0000 UTC m=+3.466387123,LastTimestamp:2026-05-28 16:03:04.983864256 +0000 UTC m=+3.466387123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:05.089581 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.089548 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" event={"ID":"fcf920ea05c3c7ff41d5c3afce1571e9","Type":"ContainerStarted","Data":"ca73bcfbdcfd7860083b6b654a735a6770f888eae6fa25e77aca86dd7835da9d"} May 28 16:03:05.089750 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.089607 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:05.090535 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.090518 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:05.090614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.090548 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:05.090614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.090561 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:05.090791 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.090770 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:05.170121 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.170031 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62f865b7e31 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:05.161383473 +0000 UTC m=+3.643906340,LastTimestamp:2026-05-28 16:03:05.161383473 +0000 UTC m=+3.643906340,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:05.180185 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.180112 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62f86d215a5 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:05.169155493 +0000 UTC m=+3.651678361,LastTimestamp:2026-05-28 16:03:05.169155493 +0000 UTC m=+3.651678361,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:05.181155 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.181132 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:05.182067 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.182048 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:05.182177 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.182081 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:05.182177 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.182117 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:05.182177 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.182158 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:05.202374 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.202352 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:05.757313 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.757279 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 16:03:05.853609 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.853577 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 16:03:05.947806 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:05.947778 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:05.963377 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:05.963345 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" May 28 16:03:06.092689 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.092587 2573 generic.go:358] "Generic (PLEG): container finished" podID="6ae5e75a733961f8d5a9aefe5c4d68d1" containerID="222e86266303708c00e24dbae43d97d69a9e785f516c6780eb45a5a293b9e858" exitCode=0 May 28 16:03:06.092689 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.092667 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:06.092689 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.092674 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" event={"ID":"6ae5e75a733961f8d5a9aefe5c4d68d1","Type":"ContainerDied","Data":"222e86266303708c00e24dbae43d97d69a9e785f516c6780eb45a5a293b9e858"} May 28 16:03:06.092876 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.092700 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:06.093568 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.093549 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:06.093568 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.093563 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:06.093568 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.093576 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:06.093783 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.093586 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:06.093783 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.093590 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:06.093783 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.093597 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:06.093783 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:06.093759 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:06.093893 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:06.093857 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:06.103914 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:06.103845 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fbe0f247e openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89727a58f44fdd814af55736088579f336f2d7df57ff1a1b369b7bf7fe3bc2ec\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:06.09590387 +0000 UTC m=+4.578426754,LastTimestamp:2026-05-28 16:03:06.09590387 +0000 UTC m=+4.578426754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:06.189779 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:06.189677 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fc3218d33 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:06.180996403 +0000 UTC m=+4.663519271,LastTimestamp:2026-05-28 16:03:06.180996403 +0000 UTC m=+4.663519271,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:06.198297 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:06.198192 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fc392ba09 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:06.188413449 +0000 UTC m=+4.670936338,LastTimestamp:2026-05-28 16:03:06.188413449 +0000 UTC m=+4.670936338,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:06.946656 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:06.946620 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:07.096746 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.096719 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/0.log" May 28 16:03:07.097054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.097032 2573 generic.go:358] "Generic (PLEG): container finished" podID="6ae5e75a733961f8d5a9aefe5c4d68d1" containerID="795c5a41dfc0369684d7202d96cb0c390765aa8a8774ea532c66faf15bfec322" exitCode=1 May 28 16:03:07.097160 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.097068 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" event={"ID":"6ae5e75a733961f8d5a9aefe5c4d68d1","Type":"ContainerDied","Data":"795c5a41dfc0369684d7202d96cb0c390765aa8a8774ea532c66faf15bfec322"} May 28 16:03:07.097160 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.097145 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:07.098149 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.098132 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:07.098231 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.098161 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:07.098231 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.098171 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:07.098389 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:07.098376 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:07.098443 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.098420 2573 scope.go:117] "RemoveContainer" containerID="795c5a41dfc0369684d7202d96cb0c390765aa8a8774ea532c66faf15bfec322" May 28 16:03:07.111821 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:07.111734 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fbe0f247e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fbe0f247e openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89727a58f44fdd814af55736088579f336f2d7df57ff1a1b369b7bf7fe3bc2ec\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:06.09590387 +0000 UTC m=+4.578426754,LastTimestamp:2026-05-28 16:03:07.101809746 +0000 UTC m=+5.584332635,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:07.188046 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:07.187941 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fc3218d33\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fc3218d33 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:06.180996403 +0000 UTC m=+4.663519271,LastTimestamp:2026-05-28 16:03:07.178411731 +0000 UTC m=+5.660934604,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:07.198167 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:07.197941 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fc392ba09\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c62fc392ba09 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:06.188413449 +0000 UTC m=+4.670936338,LastTimestamp:2026-05-28 16:03:07.186236263 +0000 UTC m=+5.668759151,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:07.947557 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:07.947530 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:08.099715 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.099687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:03:08.100076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.100061 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/0.log" May 28 16:03:08.100386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.100358 2573 generic.go:358] "Generic (PLEG): container finished" podID="6ae5e75a733961f8d5a9aefe5c4d68d1" containerID="d422e8848d8f7b4e288c01e07c7588e17179a699eb2ed3b658133680dc6bf330" exitCode=1 May 28 16:03:08.100442 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.100399 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" event={"ID":"6ae5e75a733961f8d5a9aefe5c4d68d1","Type":"ContainerDied","Data":"d422e8848d8f7b4e288c01e07c7588e17179a699eb2ed3b658133680dc6bf330"} May 28 16:03:08.100442 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.100425 2573 scope.go:117] "RemoveContainer" containerID="795c5a41dfc0369684d7202d96cb0c390765aa8a8774ea532c66faf15bfec322" May 28 16:03:08.100522 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.100469 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:08.109084 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.109068 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:08.109176 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.109119 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:08.109176 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.109135 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:08.109386 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:08.109371 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:08.109448 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.109428 2573 scope.go:117] "RemoveContainer" containerID="d422e8848d8f7b4e288c01e07c7588e17179a699eb2ed3b658133680dc6bf330" May 28 16:03:08.109586 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:08.109567 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_openshift-machine-config-operator(6ae5e75a733961f8d5a9aefe5c4d68d1)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" podUID="6ae5e75a733961f8d5a9aefe5c4d68d1" May 28 16:03:08.119428 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:08.119352 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c6303614beac openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_openshift-machine-config-operator(6ae5e75a733961f8d5a9aefe5c4d68d1),Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:08.10953694 +0000 UTC m=+6.592059829,LastTimestamp:2026-05-28 16:03:08.10953694 +0000 UTC m=+6.592059829,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:08.186979 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:08.186944 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s" May 28 16:03:08.403063 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.403018 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:08.404175 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.404156 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:08.404265 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.404189 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:08.404265 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.404202 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:08.404265 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.404239 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:08.421604 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:08.421568 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:08.752306 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:08.752266 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 16:03:08.947419 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:08.947388 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:09.103580 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.103500 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:03:09.103937 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.103922 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:09.104805 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.104785 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:09.104902 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.104816 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:09.104902 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.104829 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:09.105088 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:09.105073 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:09.105162 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.105150 2573 scope.go:117] "RemoveContainer" containerID="d422e8848d8f7b4e288c01e07c7588e17179a699eb2ed3b658133680dc6bf330" May 28 16:03:09.105309 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:09.105294 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_openshift-machine-config-operator(6ae5e75a733961f8d5a9aefe5c4d68d1)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" podUID="6ae5e75a733961f8d5a9aefe5c4d68d1" May 28 16:03:09.113392 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:09.113309 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c6303614beac\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal.18b3c6303614beac openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal,UID:6ae5e75a733961f8d5a9aefe5c4d68d1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_openshift-machine-config-operator(6ae5e75a733961f8d5a9aefe5c4d68d1),Source:EventSource{Component:kubelet,Host:ip-10-0-134-197.ec2.internal,},FirstTimestamp:2026-05-28 16:03:08.10953694 +0000 UTC m=+6.592059829,LastTimestamp:2026-05-28 16:03:09.105259865 +0000 UTC m=+7.587782752,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-197.ec2.internal,}" May 28 16:03:09.947246 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:09.947217 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:10.947854 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:10.947820 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:11.527216 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:11.527191 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 16:03:11.948085 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:11.948007 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:12.011502 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:12.011456 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-197.ec2.internal\" not found" May 28 16:03:12.049675 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:12.049642 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 16:03:12.195500 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:12.195472 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" May 28 16:03:12.947178 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:12.947149 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:13.947904 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:13.947875 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:14.596669 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:14.596638 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" May 28 16:03:14.822009 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:14.821981 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:14.822974 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:14.822955 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:14.823056 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:14.822988 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:14.823056 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:14.823005 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:14.823056 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:14.823032 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:14.842321 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:14.842300 2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-197.ec2.internal" May 28 16:03:14.946528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:14.946459 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:15.947787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:15.947761 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 16:03:16.942723 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:16.942697 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pfjm8" May 28 16:03:16.964450 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:16.964417 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:16.986344 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:16.986313 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.058637 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.058608 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.328405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.328319 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.328405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:17.328346 2573 csi_plugin.go:397] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.367596 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.367569 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.384213 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.384190 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.448224 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.448203 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.719132 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.719045 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.719132 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:17.719071 2573 csi_plugin.go:397] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.865861 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.865827 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 16:03:17.943735 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.943673 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 15:58:16 +0000 UTC" deadline="2027-10-31 22:37:15.501186028 +0000 UTC" May 28 16:03:17.943735 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.943730 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12510h33m57.55745903s" May 28 16:03:17.973383 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.973327 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:17.989415 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:17.989397 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:18.015722 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.015704 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:03:18.049035 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.049015 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:18.307471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.307408 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:18.307471 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:18.307432 2573 csi_plugin.go:397] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:18.799797 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.799738 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:03:18.935499 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.935455 2573 apiserver.go:52] "Watching apiserver" May 28 16:03:18.939049 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.939033 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 16:03:18.939156 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.939138 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=[] May 28 16:03:18.947263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:18.947247 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 16:03:20.382443 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:20.382411 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:20.398483 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:20.398453 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:20.453915 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:20.453885 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:20.582601 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:20.582564 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:03:20.714863 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:20.714804 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:20.714863 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:20.714830 2573 csi_plugin.go:397] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-197.ec2.internal" not found May 28 16:03:21.603228 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:21.603041 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-197.ec2.internal\" not found" node="ip-10-0-134-197.ec2.internal" May 28 16:03:21.798409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.798380 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 16:03:21.843293 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.843261 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 16:03:21.844341 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.844323 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientMemory" May 28 16:03:21.844451 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.844355 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasNoDiskPressure" May 28 16:03:21.844451 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.844372 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeHasSufficientPID" May 28 16:03:21.844451 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.844403 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:21.853163 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.853149 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-197.ec2.internal" May 28 16:03:21.853209 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:21.853171 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-197.ec2.internal\": node \"ip-10-0-134-197.ec2.internal\" not found" May 28 16:03:21.883131 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.883048 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-nq2bl"] May 28 16:03:21.885409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.885394 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-qgg76"] May 28 16:03:21.885540 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.885525 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:21.885601 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:21.885585 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:21.887596 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.887582 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:21.890301 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.890265 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 16:03:21.890469 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.890307 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phmg9\"" May 28 16:03:21.890469 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.890313 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 16:03:21.890469 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.890347 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 16:03:21.890629 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.890563 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 16:03:21.890629 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.890566 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 16:03:21.947435 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.947406 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" May 28 16:03:21.957744 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.957712 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 16:03:21.963078 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.963049 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 16:03:21.963246 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.963137 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" May 28 16:03:21.963246 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.963231 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal"] May 28 16:03:21.975789 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.975762 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 16:03:21.978614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.978597 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-rxhqb"] May 28 16:03:21.981032 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.981015 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb"] May 28 16:03:21.981201 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.981184 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:21.983287 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.983267 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:21.983658 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.983637 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 16:03:21.983746 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.983711 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 16:03:21.983746 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.983729 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h9l84\"" May 28 16:03:21.985367 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.985341 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 16:03:21.985476 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.985391 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 16:03:21.985476 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.985405 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kjnk2\"" May 28 16:03:21.985476 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.985444 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 16:03:21.998011 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:21.997995 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-sgbgp"] May 28 16:03:22.000506 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.000491 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.003267 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.003248 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 16:03:22.003377 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.003309 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b5c7m\"" May 28 16:03:22.003377 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.003334 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 16:03:22.003377 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.003342 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 16:03:22.005778 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.005760 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mwjk6" May 28 16:03:22.013836 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.013818 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mwjk6" May 28 16:03:22.022244 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.022207 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-197.ec2.internal" podStartSLOduration=1.022195241 podStartE2EDuration="1.022195241s" podCreationTimestamp="2026-05-28 16:03:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:22.01895491 +0000 UTC m=+20.501477800" watchObservedRunningTime="2026-05-28 16:03:22.022195241 +0000 UTC m=+20.504718130" May 28 16:03:22.022384 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.022369 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-pswbq"] May 28 16:03:22.024772 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.024754 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.024859 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.024829 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:22.052641 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052611 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:22.052641 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052643 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-system-cni-dir\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052825 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cni-binary-copy\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052825 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052825 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cnibin\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052825 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-os-release\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052825 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.052990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.052863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmq2\" (UniqueName: \"kubernetes.io/projected/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-kube-api-access-8qmq2\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.080636 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.080607 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 16:03:22.082005 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.081985 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal"] May 28 16:03:22.082343 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.082331 2573 scope.go:117] "RemoveContainer" containerID="d422e8848d8f7b4e288c01e07c7588e17179a699eb2ed3b658133680dc6bf330" May 28 16:03:22.091727 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.091709 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-5fw4k"] May 28 16:03:22.094336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.094317 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2s8jv"] May 28 16:03:22.094509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.094493 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.097325 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.097307 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7c8r6\"" May 28 16:03:22.097629 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.097612 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 16:03:22.097750 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.097644 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 16:03:22.097901 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.097887 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 16:03:22.100617 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.100597 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.103088 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.103061 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-65cpj\"" May 28 16:03:22.103230 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.103212 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 16:03:22.103747 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.103730 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 16:03:22.153596 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153572 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:22.153711 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153604 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cni-binary-copy\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.153711 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.153711 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zznp5\" (UniqueName: \"kubernetes.io/projected/e6291863-d854-4fe0-8b90-7722e873ebab-kube-api-access-zznp5\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.153711 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153699 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.153897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153731 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.153897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153750 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmq2\" (UniqueName: \"kubernetes.io/projected/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-kube-api-access-8qmq2\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.153897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20ba681e-ddad-4d53-a198-f3f21390d65d-agent-certs\") pod \"konnectivity-agent-rxhqb\" (UID: \"20ba681e-ddad-4d53-a198-f3f21390d65d\") " pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.153897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20ba681e-ddad-4d53-a198-f3f21390d65d-konnectivity-ca\") pod \"konnectivity-agent-rxhqb\" (UID: \"20ba681e-ddad-4d53-a198-f3f21390d65d\") " pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.153897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.153976 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-system-cni-dir\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154021 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154039 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-system-cni-dir\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-device-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-sys-fs\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.154150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16ca51ba-634c-4874-ad88-bf0cbd979736-host\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154156 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cnibin\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154179 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-os-release\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-socket-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cnibin\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-registration-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16ca51ba-634c-4874-ad88-bf0cbd979736-serviceca\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdk95\" (UniqueName: \"kubernetes.io/projected/16ca51ba-634c-4874-ad88-bf0cbd979736-kube-api-access-hdk95\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbqjh\" (UniqueName: \"kubernetes.io/projected/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-kube-api-access-fbqjh\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cni-binary-copy\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-os-release\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.154493 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.154493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.165967 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.165914 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 16:03:22.168574 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.168549 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:22.168693 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.168581 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:22.168693 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.168594 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:22.168776 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.168693 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:22.668660876 +0000 UTC m=+21.151183761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:22.170011 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.169982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmq2\" (UniqueName: \"kubernetes.io/projected/42537c4c-0d27-4aae-9620-a1ee4b1cbb47-kube-api-access-8qmq2\") pod \"multus-additional-cni-plugins-qgg76\" (UID: \"42537c4c-0d27-4aae-9620-a1ee4b1cbb47\") " pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.194664 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.194133 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-dk7tr"] May 28 16:03:22.194904 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.194885 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qgg76" May 28 16:03:22.197397 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.197370 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8f7nd"] May 28 16:03:22.197581 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.197563 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.200140 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.200122 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.201111 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.201076 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 16:03:22.201218 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.201128 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 16:03:22.201370 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.201345 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 16:03:22.201643 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.201620 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 16:03:22.201750 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.201729 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 16:03:22.202034 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.201952 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snkcc\"" May 28 16:03:22.202367 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.202346 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 16:03:22.202439 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.202379 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 16:03:22.203252 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.203235 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mp8h7\"" May 28 16:03:22.205081 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.205061 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 16:03:22.246600 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.246573 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-2bpn8"] May 28 16:03:22.249157 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.249141 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bpn8" May 28 16:03:22.251747 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.251713 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hdjcd\"" May 28 16:03:22.251903 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.251885 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 16:03:22.255453 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255434 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-socket-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.255545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255466 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16ca51ba-634c-4874-ad88-bf0cbd979736-serviceca\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.255545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255491 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbqjh\" (UniqueName: \"kubernetes.io/projected/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-kube-api-access-fbqjh\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.255647 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255594 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20ba681e-ddad-4d53-a198-f3f21390d65d-agent-certs\") pod \"konnectivity-agent-rxhqb\" (UID: \"20ba681e-ddad-4d53-a198-f3f21390d65d\") " pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.255647 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-socket-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.255647 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255620 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20ba681e-ddad-4d53-a198-f3f21390d65d-konnectivity-ca\") pod \"konnectivity-agent-rxhqb\" (UID: \"20ba681e-ddad-4d53-a198-f3f21390d65d\") " pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.255647 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255636 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255658 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-iptables-alerter-script\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8119d146-3ceb-4b3c-b3eb-aed911148eb1-hosts-file\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255742 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-sys-fs\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255766 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16ca51ba-634c-4874-ad88-bf0cbd979736-host\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.255789 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255792 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-registration-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.255832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255830 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdk95\" (UniqueName: \"kubernetes.io/projected/16ca51ba-634c-4874-ad88-bf0cbd979736-kube-api-access-hdk95\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-registration-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.255863 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:22.755845348 +0000 UTC m=+21.238368244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255902 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-sys-fs\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.255996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16ca51ba-634c-4874-ad88-bf0cbd979736-host\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256025 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zznp5\" (UniqueName: \"kubernetes.io/projected/e6291863-d854-4fe0-8b90-7722e873ebab-kube-api-access-zznp5\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-host-slash\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8llp\" (UniqueName: \"kubernetes.io/projected/8119d146-3ceb-4b3c-b3eb-aed911148eb1-kube-api-access-v8llp\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl4tn\" (UniqueName: \"kubernetes.io/projected/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-kube-api-access-zl4tn\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20ba681e-ddad-4d53-a198-f3f21390d65d-konnectivity-ca\") pod \"konnectivity-agent-rxhqb\" (UID: \"20ba681e-ddad-4d53-a198-f3f21390d65d\") " pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.256227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8119d146-3ceb-4b3c-b3eb-aed911148eb1-tmp-dir\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.256583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256263 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-device-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256296 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6291863-d854-4fe0-8b90-7722e873ebab-device-dir\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.256766 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.256750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16ca51ba-634c-4874-ad88-bf0cbd979736-serviceca\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.257948 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.257926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20ba681e-ddad-4d53-a198-f3f21390d65d-agent-certs\") pod \"konnectivity-agent-rxhqb\" (UID: \"20ba681e-ddad-4d53-a198-f3f21390d65d\") " pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.258213 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.258196 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-j9sl5"] May 28 16:03:22.260959 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.260944 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.261034 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.261010 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:22.267760 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.267739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdk95\" (UniqueName: \"kubernetes.io/projected/16ca51ba-634c-4874-ad88-bf0cbd979736-kube-api-access-hdk95\") pod \"node-ca-sgbgp\" (UID: \"16ca51ba-634c-4874-ad88-bf0cbd979736\") " pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.268179 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.268158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbqjh\" (UniqueName: \"kubernetes.io/projected/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-kube-api-access-fbqjh\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.269695 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.269672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zznp5\" (UniqueName: \"kubernetes.io/projected/e6291863-d854-4fe0-8b90-7722e873ebab-kube-api-access-zznp5\") pod \"aws-ebs-csi-driver-node-rwrzb\" (UID: \"e6291863-d854-4fe0-8b90-7722e873ebab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.290605 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.290579 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:22.296118 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.296078 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" May 28 16:03:22.296927 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.296907 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ba681e_ddad_4d53_a198_f3f21390d65d.slice/crio-7b30f11e01ab8e66745ef2ede9f8dfc263fbe230840eca6d78212f4d87692f28 WatchSource:0}: Error finding container 7b30f11e01ab8e66745ef2ede9f8dfc263fbe230840eca6d78212f4d87692f28: Status 404 returned error can't find the container with id 7b30f11e01ab8e66745ef2ede9f8dfc263fbe230840eca6d78212f4d87692f28 May 28 16:03:22.302004 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.301985 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6291863_d854_4fe0_8b90_7722e873ebab.slice/crio-2026d26e98c3a36034605482ed983c4792180d87c66fd3caf47843f953f0815e WatchSource:0}: Error finding container 2026d26e98c3a36034605482ed983c4792180d87c66fd3caf47843f953f0815e: Status 404 returned error can't find the container with id 2026d26e98c3a36034605482ed983c4792180d87c66fd3caf47843f953f0815e May 28 16:03:22.307933 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.307917 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sgbgp" May 28 16:03:22.313687 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.313668 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ca51ba_634c_4874_ad88_bf0cbd979736.slice/crio-77073af474271fef5d92673e22eca3d875e85212a7f5bfb858657e96483af9df WatchSource:0}: Error finding container 77073af474271fef5d92673e22eca3d875e85212a7f5bfb858657e96483af9df: Status 404 returned error can't find the container with id 77073af474271fef5d92673e22eca3d875e85212a7f5bfb858657e96483af9df May 28 16:03:22.356684 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.356684 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-systemd\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.356874 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356712 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl4tn\" (UniqueName: \"kubernetes.io/projected/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-kube-api-access-zl4tn\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.356874 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-cni-multus\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.356874 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-etc-kubernetes\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357001 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.357001 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-node-log\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357001 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.356987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f6010e-6950-43bd-8c61-e9fb352b32d6-tmp\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357129 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-os-release\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357129 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-cni-netd\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357129 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysconfig\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357129 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-multus-certs\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357245 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-log-socket\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357245 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357160 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysctl-conf\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357245 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-lib-modules\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357245 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-system-cni-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357245 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357217 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-cni-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357385 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-kubelet\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357385 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-run\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357385 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-cni-bin\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357385 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-ovn\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357384 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-modprobe-d\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-cnibin\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-hostroot\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-run-netns\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-ovnkube-script-lib\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-tuned\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-etc-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a35837a-20df-4283-880e-abe6a85b12c5-ovn-node-metrics-cert\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357598 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-host-slash\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-cni-binary-copy\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357634 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-daemon-config\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-host-slash\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-ovnkube-config\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-host\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357719 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8119d146-3ceb-4b3c-b3eb-aed911148eb1-tmp-dir\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-dbus\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357763 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bz8\" (UniqueName: \"kubernetes.io/projected/5a35837a-20df-4283-880e-abe6a85b12c5-kube-api-access-n8bz8\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-kubernetes\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.357792 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysctl-d\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdhs\" (UniqueName: \"kubernetes.io/projected/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-kube-api-access-mzdhs\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-slash\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-var-lib-kubelet\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-kubelet\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357895 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-conf-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-var-lib-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357991 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-iptables-alerter-script\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.357998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8119d146-3ceb-4b3c-b3eb-aed911148eb1-tmp-dir\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358019 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8119d146-3ceb-4b3c-b3eb-aed911148eb1-hosts-file\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8119d146-3ceb-4b3c-b3eb-aed911148eb1-hosts-file\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-socket-dir-parent\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-k8s-cni-cncf-io\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-netns\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-systemd\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358290 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-env-overrides\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-sys\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-kubelet-config\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-cni-bin\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmb6x\" (UniqueName: \"kubernetes.io/projected/f3f6010e-6950-43bd-8c61-e9fb352b32d6-kube-api-access-pmb6x\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358428 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8llp\" (UniqueName: \"kubernetes.io/projected/8119d146-3ceb-4b3c-b3eb-aed911148eb1-kube-api-access-v8llp\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358448 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-systemd-units\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.358835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.358509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-iptables-alerter-script\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.381893 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.381869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl4tn\" (UniqueName: \"kubernetes.io/projected/2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6-kube-api-access-zl4tn\") pod \"iptables-alerter-5fw4k\" (UID: \"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6\") " pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.383076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.383061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8llp\" (UniqueName: \"kubernetes.io/projected/8119d146-3ceb-4b3c-b3eb-aed911148eb1-kube-api-access-v8llp\") pod \"node-resolver-2s8jv\" (UID: \"8119d146-3ceb-4b3c-b3eb-aed911148eb1\") " pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.409651 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.409593 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fw4k" May 28 16:03:22.416215 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.416184 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2s8jv" May 28 16:03:22.416608 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.416579 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d711c6e_b7be_4a8c_a8bb_d1dfa4293bd6.slice/crio-2fa2782270448adc016a3ee1c47f6437ba5c71203f5a5e65843eca0a22d6ad36 WatchSource:0}: Error finding container 2fa2782270448adc016a3ee1c47f6437ba5c71203f5a5e65843eca0a22d6ad36: Status 404 returned error can't find the container with id 2fa2782270448adc016a3ee1c47f6437ba5c71203f5a5e65843eca0a22d6ad36 May 28 16:03:22.422717 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.422695 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8119d146_3ceb_4b3c_b3eb_aed911148eb1.slice/crio-b208c06ef94dcd68cf9f8aa3f607677028eb4a6a4b845306c99f4db4b11493de WatchSource:0}: Error finding container b208c06ef94dcd68cf9f8aa3f607677028eb4a6a4b845306c99f4db4b11493de: Status 404 returned error can't find the container with id b208c06ef94dcd68cf9f8aa3f607677028eb4a6a4b845306c99f4db4b11493de May 28 16:03:22.458723 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458693 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-kubelet-config\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.458723 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458727 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458748 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-cni-bin\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458775 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmb6x\" (UniqueName: \"kubernetes.io/projected/f3f6010e-6950-43bd-8c61-e9fb352b32d6-kube-api-access-pmb6x\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458814 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-systemd-units\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-kubelet-config\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458819 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-cni-bin\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458812 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-systemd-units\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458863 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458889 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-systemd\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458920 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-systemd\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.458921 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458914 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-cni-multus\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458952 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-etc-kubernetes\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458967 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458982 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-node-log\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458997 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f6010e-6950-43bd-8c61-e9fb352b32d6-tmp\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.458994 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-cni-multus\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459012 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-os-release\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459047 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-cni-netd\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459089 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-os-release\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-node-log\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.459120 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-cni-netd\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459127 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysconfig\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459162 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-multus-certs\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysconfig\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.459185 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret podName:b47b49db-ae4c-4948-b0e5-d76e5f8e64ff nodeName:}" failed. No retries permitted until 2026-05-28 16:03:22.959164159 +0000 UTC m=+21.441687027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret") pod "global-pull-secret-syncer-j9sl5" (UID: "b47b49db-ae4c-4948-b0e5-d76e5f8e64ff") : object "kube-system"/"original-pull-secret" not registered May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-etc-kubernetes\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459191 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-multus-certs\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.459528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459217 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-log-socket\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459245 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysctl-conf\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-log-socket\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459271 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-lib-modules\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459293 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-system-cni-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459309 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-cni-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459338 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-kubelet\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459356 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-system-cni-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459377 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-run\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-lib-modules\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-cni-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-run\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysctl-conf\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-cni-bin\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459403 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-kubelet\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459411 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-cni-bin\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459482 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-ovn\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459504 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-modprobe-d\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.460421 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459524 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-cnibin\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459541 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-hostroot\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-ovn\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459564 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-run-netns\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459588 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-ovnkube-script-lib\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-modprobe-d\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-hostroot\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-run-netns\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459652 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-cnibin\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459707 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-tuned\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459744 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-etc-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459760 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a35837a-20df-4283-880e-abe6a85b12c5-ovn-node-metrics-cert\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459782 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-cni-binary-copy\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-etc-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459848 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-daemon-config\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459877 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-ovnkube-config\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459901 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-host\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459926 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-dbus\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.461263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459952 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bz8\" (UniqueName: \"kubernetes.io/projected/5a35837a-20df-4283-880e-abe6a85b12c5-kube-api-access-n8bz8\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.459977 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-kubernetes\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460003 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysctl-d\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460030 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdhs\" (UniqueName: \"kubernetes.io/projected/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-kube-api-access-mzdhs\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460048 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-dbus\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460227 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-ovnkube-script-lib\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-host\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-cni-binary-copy\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460058 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-slash\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-kubernetes\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460385 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-var-lib-kubelet\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460419 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-kubelet\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-conf-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-sysctl-d\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460473 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-var-lib-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-slash\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460523 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-socket-dir-parent\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-ovnkube-config\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460553 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-k8s-cni-cncf-io\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-var-lib-kubelet\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460568 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-var-lib-kubelet\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460579 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-netns\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-socket-dir-parent\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460603 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-systemd\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-conf-dir\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-var-lib-openvswitch\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460640 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-k8s-cni-cncf-io\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-host-run-netns\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-run-systemd\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460669 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-env-overrides\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a35837a-20df-4283-880e-abe6a85b12c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460702 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-sys\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.460773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f6010e-6950-43bd-8c61-e9fb352b32d6-sys\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.461043 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a35837a-20df-4283-880e-abe6a85b12c5-env-overrides\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.461082 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-multus-daemon-config\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.462592 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.461670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f6010e-6950-43bd-8c61-e9fb352b32d6-tmp\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.463075 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.462011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a35837a-20df-4283-880e-abe6a85b12c5-ovn-node-metrics-cert\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.463075 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.462255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3f6010e-6950-43bd-8c61-e9fb352b32d6-etc-tuned\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.468880 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.468862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmb6x\" (UniqueName: \"kubernetes.io/projected/f3f6010e-6950-43bd-8c61-e9fb352b32d6-kube-api-access-pmb6x\") pod \"tuned-8f7nd\" (UID: \"f3f6010e-6950-43bd-8c61-e9fb352b32d6\") " pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.473400 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.473378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdhs\" (UniqueName: \"kubernetes.io/projected/5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5-kube-api-access-mzdhs\") pod \"multus-2bpn8\" (UID: \"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5\") " pod="openshift-multus/multus-2bpn8" May 28 16:03:22.473683 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.473667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bz8\" (UniqueName: \"kubernetes.io/projected/5a35837a-20df-4283-880e-abe6a85b12c5-kube-api-access-n8bz8\") pod \"ovnkube-node-dk7tr\" (UID: \"5a35837a-20df-4283-880e-abe6a85b12c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.512628 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.512587 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:22.516413 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.516390 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" May 28 16:03:22.518923 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.518894 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a35837a_20df_4283_880e_abe6a85b12c5.slice/crio-c45d6ac33a61f2ecab0135d3dd9bf3b80c710453d7d75e53074bc8f0dfc0cd6a WatchSource:0}: Error finding container c45d6ac33a61f2ecab0135d3dd9bf3b80c710453d7d75e53074bc8f0dfc0cd6a: Status 404 returned error can't find the container with id c45d6ac33a61f2ecab0135d3dd9bf3b80c710453d7d75e53074bc8f0dfc0cd6a May 28 16:03:22.524656 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.524635 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f6010e_6950_43bd_8c61_e9fb352b32d6.slice/crio-b35e344aded2b229a3101dd3ae55ed3e3e7c9bee2cec2d3d1c4dc67b0d0c5a06 WatchSource:0}: Error finding container b35e344aded2b229a3101dd3ae55ed3e3e7c9bee2cec2d3d1c4dc67b0d0c5a06: Status 404 returned error can't find the container with id b35e344aded2b229a3101dd3ae55ed3e3e7c9bee2cec2d3d1c4dc67b0d0c5a06 May 28 16:03:22.556450 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.556422 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bpn8" May 28 16:03:22.562588 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:22.562544 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8a8fbb_e4c7_4b8f_b133_b2304127fdc5.slice/crio-04577b394a4f6e4fff83271536f2da249e87ba29ddebd6ee37f435d9e968bc12 WatchSource:0}: Error finding container 04577b394a4f6e4fff83271536f2da249e87ba29ddebd6ee37f435d9e968bc12: Status 404 returned error can't find the container with id 04577b394a4f6e4fff83271536f2da249e87ba29ddebd6ee37f435d9e968bc12 May 28 16:03:22.762262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.762170 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:22.762262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.762231 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:22.763188 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.762353 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:22.763188 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.762434 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:23.762413136 +0000 UTC m=+22.244936021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:22.763188 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.762365 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:22.763188 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.762468 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:22.763188 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.762481 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:22.763188 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.762528 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:23.76251373 +0000 UTC m=+22.245036598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:22.963429 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:22.963385 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:22.963633 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.963527 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 16:03:22.963633 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:22.963593 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret podName:b47b49db-ae4c-4948-b0e5-d76e5f8e64ff nodeName:}" failed. No retries permitted until 2026-05-28 16:03:23.963575295 +0000 UTC m=+22.446098169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret") pod "global-pull-secret-syncer-j9sl5" (UID: "b47b49db-ae4c-4948-b0e5-d76e5f8e64ff") : object "kube-system"/"original-pull-secret" not registered May 28 16:03:23.017271 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.017126 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:58:22 +0000 UTC" deadline="2028-03-11 16:31:06.75817528 +0000 UTC" May 28 16:03:23.017271 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.017167 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15672h27m43.741012512s" May 28 16:03:23.138841 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.138803 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sgbgp" event={"ID":"16ca51ba-634c-4874-ad88-bf0cbd979736","Type":"ContainerStarted","Data":"77073af474271fef5d92673e22eca3d875e85212a7f5bfb858657e96483af9df"} May 28 16:03:23.141448 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.141416 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" event={"ID":"e6291863-d854-4fe0-8b90-7722e873ebab","Type":"ContainerStarted","Data":"2026d26e98c3a36034605482ed983c4792180d87c66fd3caf47843f953f0815e"} May 28 16:03:23.154222 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.154192 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:03:23.163468 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.163434 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" event={"ID":"6ae5e75a733961f8d5a9aefe5c4d68d1","Type":"ContainerStarted","Data":"7880872cc247b45d9409d4ac6471aaaabc2e32e40e279fafc8f0ab2e4c035d85"} May 28 16:03:23.179653 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.179620 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" event={"ID":"f3f6010e-6950-43bd-8c61-e9fb352b32d6","Type":"ContainerStarted","Data":"b35e344aded2b229a3101dd3ae55ed3e3e7c9bee2cec2d3d1c4dc67b0d0c5a06"} May 28 16:03:23.197668 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.197627 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxhqb" event={"ID":"20ba681e-ddad-4d53-a198-f3f21390d65d","Type":"ContainerStarted","Data":"7b30f11e01ab8e66745ef2ede9f8dfc263fbe230840eca6d78212f4d87692f28"} May 28 16:03:23.203225 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.203194 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerStarted","Data":"1c837aaf12c5b8f724adbff91b2ab07e32021bab56c9b8af6ab980acff3c3114"} May 28 16:03:23.205367 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.205340 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bpn8" event={"ID":"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5","Type":"ContainerStarted","Data":"04577b394a4f6e4fff83271536f2da249e87ba29ddebd6ee37f435d9e968bc12"} May 28 16:03:23.213579 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.213540 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"c45d6ac33a61f2ecab0135d3dd9bf3b80c710453d7d75e53074bc8f0dfc0cd6a"} May 28 16:03:23.223842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.223816 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2s8jv" event={"ID":"8119d146-3ceb-4b3c-b3eb-aed911148eb1","Type":"ContainerStarted","Data":"b208c06ef94dcd68cf9f8aa3f607677028eb4a6a4b845306c99f4db4b11493de"} May 28 16:03:23.229064 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.229038 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fw4k" event={"ID":"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6","Type":"ContainerStarted","Data":"2fa2782270448adc016a3ee1c47f6437ba5c71203f5a5e65843eca0a22d6ad36"} May 28 16:03:23.770842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.770800 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:23.771405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.770865 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:23.771405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.771050 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:23.771405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.771067 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:23.771405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.771080 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:23.771405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.771173 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:25.771154595 +0000 UTC m=+24.253677469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:23.771679 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.771611 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:23.771679 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.771661 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:25.771645852 +0000 UTC m=+24.254168728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:23.972616 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:23.972577 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:23.972788 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.972735 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 16:03:23.972851 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:23.972798 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret podName:b47b49db-ae4c-4948-b0e5-d76e5f8e64ff nodeName:}" failed. No retries permitted until 2026-05-28 16:03:25.9727802 +0000 UTC m=+24.455303072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret") pod "global-pull-secret-syncer-j9sl5" (UID: "b47b49db-ae4c-4948-b0e5-d76e5f8e64ff") : object "kube-system"/"original-pull-secret" not registered May 28 16:03:24.017918 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:24.017874 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:58:22 +0000 UTC" deadline="2027-10-26 22:08:16.294704804 +0000 UTC" May 28 16:03:24.017918 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:24.017914 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12390h4m52.276793825s" May 28 16:03:24.081814 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:24.081741 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:24.081979 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:24.081859 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:24.082288 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:24.082269 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:24.082380 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:24.082363 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:24.082515 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:24.082443 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:24.082590 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:24.082575 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:25.790924 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:25.790880 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:25.790945 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.791116 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.791135 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.791148 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.791205 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:29.791187655 +0000 UTC m=+28.273710528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.791279 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:25.791427 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.791364 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:29.791302095 +0000 UTC m=+28.273824966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:25.993309 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:25.993267 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:25.993533 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.993415 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 16:03:25.993533 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:25.993479 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret podName:b47b49db-ae4c-4948-b0e5-d76e5f8e64ff nodeName:}" failed. No retries permitted until 2026-05-28 16:03:29.993460394 +0000 UTC m=+28.475983269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret") pod "global-pull-secret-syncer-j9sl5" (UID: "b47b49db-ae4c-4948-b0e5-d76e5f8e64ff") : object "kube-system"/"original-pull-secret" not registered May 28 16:03:26.080266 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:26.080180 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:26.080432 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:26.080319 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:26.080763 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:26.080727 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:26.080868 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:26.080839 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:26.080967 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:26.080901 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:26.081019 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:26.080963 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:28.079955 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:28.079919 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:28.079955 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:28.079941 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:28.080505 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:28.080041 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:28.080505 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:28.080079 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:28.080505 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:28.080205 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:28.080505 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:28.080305 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:29.823768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:29.823488 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:29.823768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:29.823532 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:29.823768 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:29.823681 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:29.823768 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:29.823748 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:37.823728928 +0000 UTC m=+36.306251802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:29.823768 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:29.823687 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:29.824569 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:29.823779 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:29.824569 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:29.823791 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:29.824569 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:29.823822 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:37.823813012 +0000 UTC m=+36.306335895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:30.025496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:30.025446 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:30.025662 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:30.025588 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 16:03:30.025743 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:30.025723 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret podName:b47b49db-ae4c-4948-b0e5-d76e5f8e64ff nodeName:}" failed. No retries permitted until 2026-05-28 16:03:38.025704736 +0000 UTC m=+36.508227619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret") pod "global-pull-secret-syncer-j9sl5" (UID: "b47b49db-ae4c-4948-b0e5-d76e5f8e64ff") : object "kube-system"/"original-pull-secret" not registered May 28 16:03:30.079408 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:30.079325 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:30.079566 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:30.079460 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:30.079899 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:30.079875 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:30.079993 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:30.079974 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:30.080299 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:30.080172 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:30.080299 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:30.080267 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:32.079910 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:32.079871 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:32.080264 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:32.079981 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:32.080437 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:32.080415 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:32.080529 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:32.080512 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:32.080589 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:32.080577 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:32.080676 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:32.080661 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:34.079224 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:34.079190 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:34.079791 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:34.079236 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:34.079791 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:34.079190 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:34.079791 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:34.079328 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:34.079791 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:34.079376 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:34.079791 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:34.079461 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:36.078768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:36.078728 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:36.079223 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:36.078864 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:36.079223 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:36.078870 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:36.079223 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:36.079002 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:36.079223 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:36.079053 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:36.079223 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:36.079142 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:37.885466 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:37.885417 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:37.885466 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:37.885472 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:37.886000 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:37.885583 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:37.886000 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:37.885621 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:37.886000 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:37.885640 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:37.886000 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:37.885650 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:37.886000 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:37.885672 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:03:53.885651864 +0000 UTC m=+52.368174745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:37.886000 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:37.885691 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:53.885679491 +0000 UTC m=+52.368202358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:38.079058 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:38.079017 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:38.079269 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:38.079150 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:38.079269 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:38.079158 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:38.079269 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:38.079234 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:38.079269 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:38.079017 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:38.079482 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:38.079309 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:38.087647 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:38.087618 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:38.087808 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:38.087746 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 16:03:38.087854 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:38.087811 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret podName:b47b49db-ae4c-4948-b0e5-d76e5f8e64ff nodeName:}" failed. No retries permitted until 2026-05-28 16:03:54.087792187 +0000 UTC m=+52.570315055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret") pod "global-pull-secret-syncer-j9sl5" (UID: "b47b49db-ae4c-4948-b0e5-d76e5f8e64ff") : object "kube-system"/"original-pull-secret" not registered May 28 16:03:40.081165 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.079361 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:40.081165 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:40.079692 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:40.081165 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.080991 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:40.081165 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:40.081115 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:40.081776 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.081165 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:40.081776 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:40.081280 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:40.265054 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.265001 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bpn8" event={"ID":"5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5","Type":"ContainerStarted","Data":"8a7ca6426c99bd11fc71d0604c0de52833f77bf642a48acc2a19c1cd028d3e5a"} May 28 16:03:40.266984 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.266960 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"6c38a1fa701c5b85583dd9c99d58c0efc964f575278f42f630b07e505ec01853"} May 28 16:03:40.268233 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.268206 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2s8jv" event={"ID":"8119d146-3ceb-4b3c-b3eb-aed911148eb1","Type":"ContainerStarted","Data":"9195381d1a8f96c3a92d78d56b610a05c14f808f1a0bf973a104bbdd5dd713ff"} May 28 16:03:40.270905 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.269608 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sgbgp" event={"ID":"16ca51ba-634c-4874-ad88-bf0cbd979736","Type":"ContainerStarted","Data":"b53b2fa9f281cda27a3a6f16fe13050d1a524875f15d721351d4d5daf8ce3633"} May 28 16:03:40.271694 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.271666 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" event={"ID":"e6291863-d854-4fe0-8b90-7722e873ebab","Type":"ContainerStarted","Data":"25d99703ec18740fa51c06bcf0092db4ad1dcb95a8effd8df274bff55aa0c1bc"} May 28 16:03:40.273152 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.273129 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" event={"ID":"f3f6010e-6950-43bd-8c61-e9fb352b32d6","Type":"ContainerStarted","Data":"3b840fd24cacdfcd1bc741c454e8d00a507ff07d1e5655b7e4e5137a8f850259"} May 28 16:03:40.274577 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.274545 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxhqb" event={"ID":"20ba681e-ddad-4d53-a198-f3f21390d65d","Type":"ContainerStarted","Data":"cdb729d871706c05b9cda94ee6a26bc749674ba7cec28825409bd739c3273752"} May 28 16:03:40.276044 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.276023 2573 generic.go:358] "Generic (PLEG): container finished" podID="42537c4c-0d27-4aae-9620-a1ee4b1cbb47" containerID="82e6b0ba72973d5fd7ad29756387673aced02597c7a909bb60748ce78d572da5" exitCode=0 May 28 16:03:40.276145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.276055 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerDied","Data":"82e6b0ba72973d5fd7ad29756387673aced02597c7a909bb60748ce78d572da5"} May 28 16:03:40.283622 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.283571 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal" podStartSLOduration=18.283529427 podStartE2EDuration="18.283529427s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:23.179774851 +0000 UTC m=+21.662297743" watchObservedRunningTime="2026-05-28 16:03:40.283529427 +0000 UTC m=+38.766052314" May 28 16:03:40.284447 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.284328 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2bpn8" podStartSLOduration=0.928817672 podStartE2EDuration="18.284312681s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.564238659 +0000 UTC m=+21.046761527" lastFinishedPulling="2026-05-28 16:03:39.919733654 +0000 UTC m=+38.402256536" observedRunningTime="2026-05-28 16:03:40.283499772 +0000 UTC m=+38.766022727" watchObservedRunningTime="2026-05-28 16:03:40.284312681 +0000 UTC m=+38.766835572" May 28 16:03:40.338356 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.338298 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sgbgp" podStartSLOduration=6.212047132 podStartE2EDuration="19.338278361s" podCreationTimestamp="2026-05-28 16:03:21 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.314984492 +0000 UTC m=+20.797507360" lastFinishedPulling="2026-05-28 16:03:35.44121572 +0000 UTC m=+33.923738589" observedRunningTime="2026-05-28 16:03:40.317226793 +0000 UTC m=+38.799749684" watchObservedRunningTime="2026-05-28 16:03:40.338278361 +0000 UTC m=+38.820801251" May 28 16:03:40.354268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.354211 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rxhqb" podStartSLOduration=1.778782879 podStartE2EDuration="19.354196732s" podCreationTimestamp="2026-05-28 16:03:21 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.298849913 +0000 UTC m=+20.781372781" lastFinishedPulling="2026-05-28 16:03:39.874263753 +0000 UTC m=+38.356786634" observedRunningTime="2026-05-28 16:03:40.353886691 +0000 UTC m=+38.836409580" watchObservedRunningTime="2026-05-28 16:03:40.354196732 +0000 UTC m=+38.836719621" May 28 16:03:40.354405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.354289 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8f7nd" podStartSLOduration=1.004618167 podStartE2EDuration="18.354284229s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.526132041 +0000 UTC m=+21.008654908" lastFinishedPulling="2026-05-28 16:03:39.875798088 +0000 UTC m=+38.358320970" observedRunningTime="2026-05-28 16:03:40.339642367 +0000 UTC m=+38.822165257" watchObservedRunningTime="2026-05-28 16:03:40.354284229 +0000 UTC m=+38.836807120" May 28 16:03:40.368383 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:40.368315 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2s8jv" podStartSLOduration=0.918115055 podStartE2EDuration="18.368297578s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.424066306 +0000 UTC m=+20.906589177" lastFinishedPulling="2026-05-28 16:03:39.874248831 +0000 UTC m=+38.356771700" observedRunningTime="2026-05-28 16:03:40.367640575 +0000 UTC m=+38.850163466" watchObservedRunningTime="2026-05-28 16:03:40.368297578 +0000 UTC m=+38.850820468" May 28 16:03:41.061982 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.061954 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 16:03:41.279440 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.279353 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fw4k" event={"ID":"2d711c6e-b7be-4a8c-a8bb-d1dfa4293bd6","Type":"ContainerStarted","Data":"5f161eb45afd4a1e764cf671ac00f77878a96051f3aa3fb6643fb787fd81e4cc"} May 28 16:03:41.280858 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.280835 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" event={"ID":"e6291863-d854-4fe0-8b90-7722e873ebab","Type":"ContainerStarted","Data":"31922d890fb10008f394d09a4947f84ed5a9e16570d7143349561f59788796ec"} May 28 16:03:41.283308 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.283265 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"144dfa59028e69801c04778b1872166615e0f70817d25ce0444926629caafc52"} May 28 16:03:41.283308 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.283299 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"f21b9243f1d2edad962ae169cb5adf1066e51a43902a02af498bc3780f7215e4"} May 28 16:03:41.283441 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.283313 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"28dd9a088c3bedb0ccbff53fe05c3c679b2968c7925050628ce4297b356affa2"} May 28 16:03:41.283441 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.283326 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"3cb2d3edd4a8d216903ec670b4223549828a141b86870c88a4e0b97a2949f2d9"} May 28 16:03:41.283441 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.283338 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"4064bf2cc35d37e9274eff5895f9586bc9037ad1288adcc66923e462b1503db1"} May 28 16:03:41.295022 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:41.294969 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5fw4k" podStartSLOduration=6.272691746 podStartE2EDuration="19.294954902s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.418953581 +0000 UTC m=+20.901476448" lastFinishedPulling="2026-05-28 16:03:35.441216721 +0000 UTC m=+33.923739604" observedRunningTime="2026-05-28 16:03:41.294851592 +0000 UTC m=+39.777374484" watchObservedRunningTime="2026-05-28 16:03:41.294954902 +0000 UTC m=+39.777477794" May 28 16:03:42.035221 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.035120 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T16:03:41.061976948Z","UUID":"782fea4f-a670-44e6-999a-4230b8c92a4d","Handler":null,"Name":"","Endpoint":""} May 28 16:03:42.038077 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.038051 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 16:03:42.038077 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.038080 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 16:03:42.080319 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.080284 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:42.080497 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.080333 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:42.080497 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:42.080380 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:42.080631 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:42.080498 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:42.080631 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.080520 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:42.080735 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:42.080623 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:42.287827 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.287711 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" event={"ID":"e6291863-d854-4fe0-8b90-7722e873ebab","Type":"ContainerStarted","Data":"3030794a141feb208a20fa581c64a3181b2879579cdbdb7bf25268fec2ce8e54"} May 28 16:03:42.291260 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.291241 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:42.291793 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.291773 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:42.309664 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:42.309613 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwrzb" podStartSLOduration=1.7220158460000001 podStartE2EDuration="21.309599644s" podCreationTimestamp="2026-05-28 16:03:21 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.303406596 +0000 UTC m=+20.785929464" lastFinishedPulling="2026-05-28 16:03:41.890990394 +0000 UTC m=+40.373513262" observedRunningTime="2026-05-28 16:03:42.309508184 +0000 UTC m=+40.792031096" watchObservedRunningTime="2026-05-28 16:03:42.309599644 +0000 UTC m=+40.792122535" May 28 16:03:43.292603 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.292564 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"fb0c171f8c78410610997c803be6e63883730494f5fcf73a21c94c5f8eafa033"} May 28 16:03:43.509611 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.509575 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2dgh2"] May 28 16:03:43.511512 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.511495 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.514167 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.514144 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 16:03:43.514307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.514240 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 16:03:43.514678 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.514652 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 16:03:43.514678 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.514666 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 16:03:43.514844 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.514666 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 16:03:43.514844 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.514725 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gfwpb\"" May 28 16:03:43.515332 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.515319 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 16:03:43.628117 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-root\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628117 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-tls\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628344 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-metrics-client-ca\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628344 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628344 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-sys\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628344 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-accelerators-collector-config\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628344 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-textfile\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628538 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-wtmp\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.628538 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.628419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ls6g\" (UniqueName: \"kubernetes.io/projected/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-kube-api-access-5ls6g\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.728791 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728754 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-textfile\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.728791 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728798 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-wtmp\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728825 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ls6g\" (UniqueName: \"kubernetes.io/projected/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-kube-api-access-5ls6g\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728850 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-root\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728896 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-tls\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728932 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-metrics-client-ca\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-root\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.728969 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-wtmp\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729030 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-sys\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-sys\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:43.729088 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 16:03:43.729405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729119 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-accelerators-collector-config\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-textfile\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729405 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:43.729171 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-tls podName:9bb45cfc-b365-4eb6-8e01-02037ffa6b16 nodeName:}" failed. No retries permitted until 2026-05-28 16:03:44.229150804 +0000 UTC m=+42.711673672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-tls") pod "node-exporter-2dgh2" (UID: "9bb45cfc-b365-4eb6-8e01-02037ffa6b16") : secret "node-exporter-tls" not found May 28 16:03:43.729620 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-metrics-client-ca\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.729670 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.729636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-accelerators-collector-config\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.733469 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.733438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:43.742477 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:43.742449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ls6g\" (UniqueName: \"kubernetes.io/projected/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-kube-api-access-5ls6g\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:44.078774 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:44.078740 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:44.078934 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:44.078750 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:44.078934 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:44.078749 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:44.079077 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:44.078840 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:44.079077 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:44.079051 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:44.079077 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:44.078927 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:44.233215 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:44.233187 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-tls\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:44.235449 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:44.235432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bb45cfc-b365-4eb6-8e01-02037ffa6b16-node-exporter-tls\") pod \"node-exporter-2dgh2\" (UID: \"9bb45cfc-b365-4eb6-8e01-02037ffa6b16\") " pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:44.421472 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:44.421368 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2dgh2" May 28 16:03:44.430313 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:44.430276 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb45cfc_b365_4eb6_8e01_02037ffa6b16.slice/crio-face72f48dd0099a59e25b594c5075f9395dfea93f926d0dc61893cf931ec4d6 WatchSource:0}: Error finding container face72f48dd0099a59e25b594c5075f9395dfea93f926d0dc61893cf931ec4d6: Status 404 returned error can't find the container with id face72f48dd0099a59e25b594c5075f9395dfea93f926d0dc61893cf931ec4d6 May 28 16:03:45.297718 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:45.297688 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dgh2" event={"ID":"9bb45cfc-b365-4eb6-8e01-02037ffa6b16","Type":"ContainerStarted","Data":"face72f48dd0099a59e25b594c5075f9395dfea93f926d0dc61893cf931ec4d6"} May 28 16:03:46.078954 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.078900 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:46.078954 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.078916 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:46.079334 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:46.079028 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:46.079334 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.079125 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:46.079334 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:46.079131 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:46.079334 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:46.079219 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:46.303419 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.303186 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" event={"ID":"5a35837a-20df-4283-880e-abe6a85b12c5","Type":"ContainerStarted","Data":"978785bb2cf81cf29e6536ab62a1472ef89a951d11c661052873dabfa2b382a4"} May 28 16:03:46.303576 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.303505 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:46.303576 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.303527 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:46.303576 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.303537 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:46.319521 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.319490 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:46.319669 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.319562 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:03:46.335295 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:46.335251 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" podStartSLOduration=6.727284197 podStartE2EDuration="24.335238297s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.521046018 +0000 UTC m=+21.003568886" lastFinishedPulling="2026-05-28 16:03:40.129000104 +0000 UTC m=+38.611522986" observedRunningTime="2026-05-28 16:03:46.333811404 +0000 UTC m=+44.816334296" watchObservedRunningTime="2026-05-28 16:03:46.335238297 +0000 UTC m=+44.817761226" May 28 16:03:47.307122 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:47.307058 2573 generic.go:358] "Generic (PLEG): container finished" podID="42537c4c-0d27-4aae-9620-a1ee4b1cbb47" containerID="824445bbb23f988f0dade5dcc0120b9d9a3e37c79488f66034f021d070be924c" exitCode=0 May 28 16:03:47.307729 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:47.307129 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerDied","Data":"824445bbb23f988f0dade5dcc0120b9d9a3e37c79488f66034f021d070be924c"} May 28 16:03:48.079716 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.079474 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:48.079871 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:48.079824 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:48.079871 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.079556 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:48.080185 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:48.079920 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:48.080185 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.079546 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:48.080185 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:48.079998 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:48.084471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.084440 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pswbq"] May 28 16:03:48.086696 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.086670 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nq2bl"] May 28 16:03:48.087448 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.087411 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j9sl5"] May 28 16:03:48.309953 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.309921 2573 generic.go:358] "Generic (PLEG): container finished" podID="9bb45cfc-b365-4eb6-8e01-02037ffa6b16" containerID="3ab76b01c4f7d89e80bfb8778ad78aff37d3035d5822877d27fa5c57521fce34" exitCode=0 May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.310032 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dgh2" event={"ID":"9bb45cfc-b365-4eb6-8e01-02037ffa6b16","Type":"ContainerDied","Data":"3ab76b01c4f7d89e80bfb8778ad78aff37d3035d5822877d27fa5c57521fce34"} May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.310050 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.310210 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:48.310209 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:48.310303 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:48.310303 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:48.310509 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:48.310393 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:49.194555 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.194514 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:49.194720 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.194676 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 16:03:49.195287 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.195261 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rxhqb" May 28 16:03:49.313323 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.313292 2573 generic.go:358] "Generic (PLEG): container finished" podID="42537c4c-0d27-4aae-9620-a1ee4b1cbb47" containerID="e0df00767e241c8d2e1fb1c8081238f55c04cc73e555c0f5c95468021476bc4a" exitCode=0 May 28 16:03:49.313832 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.313379 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerDied","Data":"e0df00767e241c8d2e1fb1c8081238f55c04cc73e555c0f5c95468021476bc4a"} May 28 16:03:49.315333 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.315310 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dgh2" event={"ID":"9bb45cfc-b365-4eb6-8e01-02037ffa6b16","Type":"ContainerStarted","Data":"475c2c77e82ad870ddc770e1a19e8bea25b0066d2b741da7c1fb02cd00455d22"} May 28 16:03:49.315414 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.315339 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dgh2" event={"ID":"9bb45cfc-b365-4eb6-8e01-02037ffa6b16","Type":"ContainerStarted","Data":"f8faca38ae89c0e2da23612c65a979f49c257cba4682aa62f9b82c4695a22133"} May 28 16:03:49.400237 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:49.400178 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2dgh2" podStartSLOduration=3.54258492 podStartE2EDuration="6.400162799s" podCreationTimestamp="2026-05-28 16:03:43 +0000 UTC" firstStartedPulling="2026-05-28 16:03:44.432532361 +0000 UTC m=+42.915055229" lastFinishedPulling="2026-05-28 16:03:47.290110237 +0000 UTC m=+45.772633108" observedRunningTime="2026-05-28 16:03:49.399693022 +0000 UTC m=+47.882215906" watchObservedRunningTime="2026-05-28 16:03:49.400162799 +0000 UTC m=+47.882685738" May 28 16:03:50.079459 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:50.079428 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:50.079459 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:50.079454 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:50.079707 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:50.079428 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:50.079707 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:50.079582 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:50.079707 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:50.079657 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:50.079808 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:50.079732 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:51.321138 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:51.321084 2573 generic.go:358] "Generic (PLEG): container finished" podID="42537c4c-0d27-4aae-9620-a1ee4b1cbb47" containerID="539915fabb1df62ff9f5769a3deca27e0c509fbb630037068437d249ba612101" exitCode=0 May 28 16:03:51.321624 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:51.321138 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerDied","Data":"539915fabb1df62ff9f5769a3deca27e0c509fbb630037068437d249ba612101"} May 28 16:03:52.079927 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.079887 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:52.080145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.079989 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:52.080145 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:52.080067 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9sl5" podUID="b47b49db-ae4c-4948-b0e5-d76e5f8e64ff" May 28 16:03:52.080145 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:52.080067 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nq2bl" podUID="9d633331-04cc-4ebd-b1be-b3d2fab53be8" May 28 16:03:52.080145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.080135 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:52.080357 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:52.080302 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pswbq" podUID="a1b0dac5-1ebf-4aac-a379-618a1b7d86bb" May 28 16:03:52.881966 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.881887 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-197.ec2.internal" event="NodeReady" May 28 16:03:52.882453 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.882037 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 16:03:52.970183 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.970140 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-glzgk"] May 28 16:03:52.996593 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.996558 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-64mlt"] May 28 16:03:52.996754 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:52.996705 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.001729 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.001703 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 16:03:53.001892 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.001828 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 16:03:53.002361 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.002158 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-whswg\"" May 28 16:03:53.002556 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.002535 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 16:03:53.012925 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.012893 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-glzgk"] May 28 16:03:53.013045 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.012929 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64mlt"] May 28 16:03:53.013045 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.012997 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.018506 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.018387 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 16:03:53.018750 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.018731 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cq7wp\"" May 28 16:03:53.018839 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.018731 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 16:03:53.109335 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.109303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm82l\" (UniqueName: \"kubernetes.io/projected/7b2581e8-370f-42d7-ac17-b6b07581dc04-kube-api-access-mm82l\") pod \"ingress-canary-glzgk\" (UID: \"7b2581e8-370f-42d7-ac17-b6b07581dc04\") " pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.109511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.109353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94e87f7f-08b8-489e-a3de-ba6860bd4a43-config-volume\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.109511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.109387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b2581e8-370f-42d7-ac17-b6b07581dc04-cert\") pod \"ingress-canary-glzgk\" (UID: \"7b2581e8-370f-42d7-ac17-b6b07581dc04\") " pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.109511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.109414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94e87f7f-08b8-489e-a3de-ba6860bd4a43-metrics-tls\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.109511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.109444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e87f7f-08b8-489e-a3de-ba6860bd4a43-tmp-dir\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.109727 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.109543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtq4\" (UniqueName: \"kubernetes.io/projected/94e87f7f-08b8-489e-a3de-ba6860bd4a43-kube-api-access-kwtq4\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.210703 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.210618 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b2581e8-370f-42d7-ac17-b6b07581dc04-cert\") pod \"ingress-canary-glzgk\" (UID: \"7b2581e8-370f-42d7-ac17-b6b07581dc04\") " pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.210703 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.210659 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94e87f7f-08b8-489e-a3de-ba6860bd4a43-metrics-tls\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.210703 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.210688 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e87f7f-08b8-489e-a3de-ba6860bd4a43-tmp-dir\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.210965 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.210915 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtq4\" (UniqueName: \"kubernetes.io/projected/94e87f7f-08b8-489e-a3de-ba6860bd4a43-kube-api-access-kwtq4\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.211018 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.211005 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mm82l\" (UniqueName: \"kubernetes.io/projected/7b2581e8-370f-42d7-ac17-b6b07581dc04-kube-api-access-mm82l\") pod \"ingress-canary-glzgk\" (UID: \"7b2581e8-370f-42d7-ac17-b6b07581dc04\") " pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.211057 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.211040 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94e87f7f-08b8-489e-a3de-ba6860bd4a43-config-volume\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.211348 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.211321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e87f7f-08b8-489e-a3de-ba6860bd4a43-tmp-dir\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.211765 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.211738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94e87f7f-08b8-489e-a3de-ba6860bd4a43-config-volume\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.215301 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.215279 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94e87f7f-08b8-489e-a3de-ba6860bd4a43-metrics-tls\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.215453 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.215428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b2581e8-370f-42d7-ac17-b6b07581dc04-cert\") pod \"ingress-canary-glzgk\" (UID: \"7b2581e8-370f-42d7-ac17-b6b07581dc04\") " pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.236172 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.236144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm82l\" (UniqueName: \"kubernetes.io/projected/7b2581e8-370f-42d7-ac17-b6b07581dc04-kube-api-access-mm82l\") pod \"ingress-canary-glzgk\" (UID: \"7b2581e8-370f-42d7-ac17-b6b07581dc04\") " pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.236655 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.236634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtq4\" (UniqueName: \"kubernetes.io/projected/94e87f7f-08b8-489e-a3de-ba6860bd4a43-kube-api-access-kwtq4\") pod \"dns-default-64mlt\" (UID: \"94e87f7f-08b8-489e-a3de-ba6860bd4a43\") " pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.308636 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.308599 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-glzgk" May 28 16:03:53.322606 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.322573 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64mlt" May 28 16:03:53.499815 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.499778 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64mlt"] May 28 16:03:53.503287 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.503262 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-glzgk"] May 28 16:03:53.504507 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:53.504390 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e87f7f_08b8_489e_a3de_ba6860bd4a43.slice/crio-398716d0ffe9bfa7afaff9947833a4b77d9ab303e82c32692ecda313eec0e76d WatchSource:0}: Error finding container 398716d0ffe9bfa7afaff9947833a4b77d9ab303e82c32692ecda313eec0e76d: Status 404 returned error can't find the container with id 398716d0ffe9bfa7afaff9947833a4b77d9ab303e82c32692ecda313eec0e76d May 28 16:03:53.506813 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:53.506735 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2581e8_370f_42d7_ac17_b6b07581dc04.slice/crio-11a954f5aef2ede96e62de98432d2146ad132e065bd79631a43731cd3ddc281b WatchSource:0}: Error finding container 11a954f5aef2ede96e62de98432d2146ad132e065bd79631a43731cd3ddc281b: Status 404 returned error can't find the container with id 11a954f5aef2ede96e62de98432d2146ad132e065bd79631a43731cd3ddc281b May 28 16:03:53.916315 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.916223 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:53.916315 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:53.916276 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:53.917110 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:53.916413 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 16:03:53.917110 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:53.916428 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 16:03:53.917110 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:53.916437 2573 projected.go:194] Error preparing data for projected volume kube-api-access-lzr85 for pod openshift-network-diagnostics/network-check-target-nq2bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:53.917110 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:53.916432 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:53.917110 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:53.916495 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85 podName:9d633331-04cc-4ebd-b1be-b3d2fab53be8 nodeName:}" failed. No retries permitted until 2026-05-28 16:04:25.916475866 +0000 UTC m=+84.398998759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzr85" (UniqueName: "kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85") pod "network-check-target-nq2bl" (UID: "9d633331-04cc-4ebd-b1be-b3d2fab53be8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 16:03:53.917110 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:03:53.916513 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs podName:a1b0dac5-1ebf-4aac-a379-618a1b7d86bb nodeName:}" failed. No retries permitted until 2026-05-28 16:04:25.916506635 +0000 UTC m=+84.399029509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs") pod "network-metrics-daemon-pswbq" (UID: "a1b0dac5-1ebf-4aac-a379-618a1b7d86bb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 16:03:54.080503 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.079728 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:03:54.080671 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.080397 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:54.080730 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.080537 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:03:54.085971 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.085453 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 16:03:54.085971 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.085552 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 16:03:54.085971 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.085757 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 16:03:54.085971 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.085837 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66q44\"" May 28 16:03:54.086312 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.086166 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 16:03:54.086312 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.086223 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sjf64\"" May 28 16:03:54.118775 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.118306 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:54.122552 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.122498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b47b49db-ae4c-4948-b0e5-d76e5f8e64ff-original-pull-secret\") pod \"global-pull-secret-syncer-j9sl5\" (UID: \"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff\") " pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:54.330880 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.330841 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-glzgk" event={"ID":"7b2581e8-370f-42d7-ac17-b6b07581dc04","Type":"ContainerStarted","Data":"11a954f5aef2ede96e62de98432d2146ad132e065bd79631a43731cd3ddc281b"} May 28 16:03:54.332425 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.332397 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64mlt" event={"ID":"94e87f7f-08b8-489e-a3de-ba6860bd4a43","Type":"ContainerStarted","Data":"398716d0ffe9bfa7afaff9947833a4b77d9ab303e82c32692ecda313eec0e76d"} May 28 16:03:54.402514 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.402476 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9sl5" May 28 16:03:54.567642 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:54.567604 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j9sl5"] May 28 16:03:54.573840 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:03:54.573810 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47b49db_ae4c_4948_b0e5_d76e5f8e64ff.slice/crio-3d8cb03792531516e07c209b83fd27f7b9d69d41c9244b04a03a1c7aeba61b75 WatchSource:0}: Error finding container 3d8cb03792531516e07c209b83fd27f7b9d69d41c9244b04a03a1c7aeba61b75: Status 404 returned error can't find the container with id 3d8cb03792531516e07c209b83fd27f7b9d69d41c9244b04a03a1c7aeba61b75 May 28 16:03:55.335796 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:03:55.335751 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j9sl5" event={"ID":"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff","Type":"ContainerStarted","Data":"3d8cb03792531516e07c209b83fd27f7b9d69d41c9244b04a03a1c7aeba61b75"} May 28 16:04:00.350260 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:00.349780 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-glzgk" event={"ID":"7b2581e8-370f-42d7-ac17-b6b07581dc04","Type":"ContainerStarted","Data":"862e7040d6853b90bf7457709501a63ada3d0bbf0e9e90280937614e6ba93e30"} May 28 16:04:00.354652 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:00.354615 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerStarted","Data":"2b5a5ae872fb770697c31680277d88d08d0400b8befc58c334f591091562d9dc"} May 28 16:04:00.356706 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:00.356679 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64mlt" event={"ID":"94e87f7f-08b8-489e-a3de-ba6860bd4a43","Type":"ContainerStarted","Data":"7510d8037bbc8e49c44c678a443d84f7190646fc5e8afacd12c6ae4625c07851"} May 28 16:04:00.367958 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:00.367905 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-glzgk" podStartSLOduration=3.122623732 podStartE2EDuration="8.367887151s" podCreationTimestamp="2026-05-28 16:03:52 +0000 UTC" firstStartedPulling="2026-05-28 16:03:53.508773844 +0000 UTC m=+51.991296715" lastFinishedPulling="2026-05-28 16:03:58.754037249 +0000 UTC m=+57.236560134" observedRunningTime="2026-05-28 16:04:00.367336163 +0000 UTC m=+58.849859055" watchObservedRunningTime="2026-05-28 16:04:00.367887151 +0000 UTC m=+58.850410042" May 28 16:04:01.362049 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.362014 2573 generic.go:358] "Generic (PLEG): container finished" podID="42537c4c-0d27-4aae-9620-a1ee4b1cbb47" containerID="2b5a5ae872fb770697c31680277d88d08d0400b8befc58c334f591091562d9dc" exitCode=0 May 28 16:04:01.362492 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.362083 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerDied","Data":"2b5a5ae872fb770697c31680277d88d08d0400b8befc58c334f591091562d9dc"} May 28 16:04:01.363657 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.363633 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64mlt" event={"ID":"94e87f7f-08b8-489e-a3de-ba6860bd4a43","Type":"ContainerStarted","Data":"6f5803252c4225d08d69e5d3905dbc7d3ac8f5d8921e9f249bd84e48641f7274"} May 28 16:04:01.363810 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.363777 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-64mlt" May 28 16:04:01.364872 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.364847 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j9sl5" event={"ID":"b47b49db-ae4c-4948-b0e5-d76e5f8e64ff","Type":"ContainerStarted","Data":"c54266866da41d4974093b34b9738c182c014ed991b68f6685df0f333adc154e"} May 28 16:04:01.398175 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.398114 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j9sl5" podStartSLOduration=33.3488506 podStartE2EDuration="39.398078433s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:03:54.57716053 +0000 UTC m=+53.059683407" lastFinishedPulling="2026-05-28 16:04:00.62638836 +0000 UTC m=+59.108911240" observedRunningTime="2026-05-28 16:04:01.397839571 +0000 UTC m=+59.880362462" watchObservedRunningTime="2026-05-28 16:04:01.398078433 +0000 UTC m=+59.880601324" May 28 16:04:01.413774 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:01.413722 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-64mlt" podStartSLOduration=4.167366431 podStartE2EDuration="9.413704239s" podCreationTimestamp="2026-05-28 16:03:52 +0000 UTC" firstStartedPulling="2026-05-28 16:03:53.506996979 +0000 UTC m=+51.989519862" lastFinishedPulling="2026-05-28 16:03:58.753334789 +0000 UTC m=+57.235857670" observedRunningTime="2026-05-28 16:04:01.413470052 +0000 UTC m=+59.895992943" watchObservedRunningTime="2026-05-28 16:04:01.413704239 +0000 UTC m=+59.896227134" May 28 16:04:02.369531 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:02.369491 2573 generic.go:358] "Generic (PLEG): container finished" podID="42537c4c-0d27-4aae-9620-a1ee4b1cbb47" containerID="46682bc01564526c806d70dc6e7bb0e71f315f4ff5da42ea5a32af1053848c74" exitCode=0 May 28 16:04:02.369910 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:02.369573 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerDied","Data":"46682bc01564526c806d70dc6e7bb0e71f315f4ff5da42ea5a32af1053848c74"} May 28 16:04:03.374674 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:03.374636 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgg76" event={"ID":"42537c4c-0d27-4aae-9620-a1ee4b1cbb47","Type":"ContainerStarted","Data":"7e403e752c637995354e8037cc5fa151e89be70c5c4e8b7356f20025163374f8"} May 28 16:04:03.398411 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:03.398360 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qgg76" podStartSLOduration=4.433122439 podStartE2EDuration="42.398345557s" podCreationTimestamp="2026-05-28 16:03:21 +0000 UTC" firstStartedPulling="2026-05-28 16:03:22.203434689 +0000 UTC m=+20.685957559" lastFinishedPulling="2026-05-28 16:04:00.168657795 +0000 UTC m=+58.651180677" observedRunningTime="2026-05-28 16:04:03.396621713 +0000 UTC m=+61.879144602" watchObservedRunningTime="2026-05-28 16:04:03.398345557 +0000 UTC m=+61.880868441" May 28 16:04:09.073052 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:09.073020 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-glzgk_7b2581e8-370f-42d7-ac17-b6b07581dc04/serve-healthcheck-canary/0.log" May 28 16:04:11.372274 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:11.372237 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-64mlt" May 28 16:04:18.320547 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:18.320521 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dk7tr" May 28 16:04:25.957543 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.957398 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:04:25.957543 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.957447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:04:25.960768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.960744 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 16:04:25.961597 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.961582 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 16:04:25.970543 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.970518 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1b0dac5-1ebf-4aac-a379-618a1b7d86bb-metrics-certs\") pod \"network-metrics-daemon-pswbq\" (UID: \"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb\") " pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:04:25.970726 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.970708 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 16:04:25.980059 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:25.980038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzr85\" (UniqueName: \"kubernetes.io/projected/9d633331-04cc-4ebd-b1be-b3d2fab53be8-kube-api-access-lzr85\") pod \"network-check-target-nq2bl\" (UID: \"9d633331-04cc-4ebd-b1be-b3d2fab53be8\") " pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:04:26.196833 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.196799 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66q44\"" May 28 16:04:26.204990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.204972 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:04:26.212396 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.212374 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sjf64\"" May 28 16:04:26.220666 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.220647 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pswbq" May 28 16:04:26.340167 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.340130 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nq2bl"] May 28 16:04:26.343973 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:04:26.343943 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d633331_04cc_4ebd_b1be_b3d2fab53be8.slice/crio-d576d39a38a54340a5e804a527e7041d903caa930c721eaaa484683c2cd89cc0 WatchSource:0}: Error finding container d576d39a38a54340a5e804a527e7041d903caa930c721eaaa484683c2cd89cc0: Status 404 returned error can't find the container with id d576d39a38a54340a5e804a527e7041d903caa930c721eaaa484683c2cd89cc0 May 28 16:04:26.359203 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.359177 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pswbq"] May 28 16:04:26.361888 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:04:26.361866 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b0dac5_1ebf_4aac_a379_618a1b7d86bb.slice/crio-42be04fbdea32fd7595c0ad1a3f1efb34e9cdf6e55b63feb310537838c652cf5 WatchSource:0}: Error finding container 42be04fbdea32fd7595c0ad1a3f1efb34e9cdf6e55b63feb310537838c652cf5: Status 404 returned error can't find the container with id 42be04fbdea32fd7595c0ad1a3f1efb34e9cdf6e55b63feb310537838c652cf5 May 28 16:04:26.433313 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.433279 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pswbq" event={"ID":"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb","Type":"ContainerStarted","Data":"42be04fbdea32fd7595c0ad1a3f1efb34e9cdf6e55b63feb310537838c652cf5"} May 28 16:04:26.434259 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:26.434238 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nq2bl" event={"ID":"9d633331-04cc-4ebd-b1be-b3d2fab53be8","Type":"ContainerStarted","Data":"d576d39a38a54340a5e804a527e7041d903caa930c721eaaa484683c2cd89cc0"} May 28 16:04:28.441170 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:28.441068 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pswbq" event={"ID":"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb","Type":"ContainerStarted","Data":"573e6e8637aeca01c0f429ba0dbccf1238ef5f73b1a8262b6c51776b78131741"} May 28 16:04:28.441170 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:28.441127 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pswbq" event={"ID":"a1b0dac5-1ebf-4aac-a379-618a1b7d86bb","Type":"ContainerStarted","Data":"6249497aaa6b64a42f52f860ae011d238ee730455074056e07d9f890f4272ab0"} May 28 16:04:28.457918 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:28.457858 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pswbq" podStartSLOduration=64.95741304 podStartE2EDuration="1m6.457836492s" podCreationTimestamp="2026-05-28 16:03:22 +0000 UTC" firstStartedPulling="2026-05-28 16:04:26.36362602 +0000 UTC m=+84.846148888" lastFinishedPulling="2026-05-28 16:04:27.864049456 +0000 UTC m=+86.346572340" observedRunningTime="2026-05-28 16:04:28.456408496 +0000 UTC m=+86.938931389" watchObservedRunningTime="2026-05-28 16:04:28.457836492 +0000 UTC m=+86.940359384" May 28 16:04:30.451083 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:30.451039 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nq2bl" event={"ID":"9d633331-04cc-4ebd-b1be-b3d2fab53be8","Type":"ContainerStarted","Data":"f88377436d1950088af43ee547fc1e5a50b13e31d167df5f4e9b5f277b3e4f56"} May 28 16:04:30.451486 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:30.451211 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:04:30.469776 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:04:30.469724 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nq2bl" podStartSLOduration=66.261526851 podStartE2EDuration="1m9.469707189s" podCreationTimestamp="2026-05-28 16:03:21 +0000 UTC" firstStartedPulling="2026-05-28 16:04:26.345994969 +0000 UTC m=+84.828517837" lastFinishedPulling="2026-05-28 16:04:29.554175308 +0000 UTC m=+88.036698175" observedRunningTime="2026-05-28 16:04:30.468357481 +0000 UTC m=+88.950880362" watchObservedRunningTime="2026-05-28 16:04:30.469707189 +0000 UTC m=+88.952230078" May 28 16:05:01.456671 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:01.456638 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nq2bl" May 28 16:05:56.112734 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.112648 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hgdz7"] May 28 16:05:56.115471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.115446 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.117710 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.117681 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 16:05:56.117853 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.117818 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-67m8x\"" May 28 16:05:56.118052 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.118038 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 16:05:56.118889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.118866 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 16:05:56.118954 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.118888 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 16:05:56.129249 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.129226 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hgdz7"] May 28 16:05:56.221063 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.221031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c102c78-43aa-4aae-855c-56de3c87a7d4-crio-socket\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.221063 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.221064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx4v9\" (UniqueName: \"kubernetes.io/projected/0c102c78-43aa-4aae-855c-56de3c87a7d4-kube-api-access-rx4v9\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.221332 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.221091 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c102c78-43aa-4aae-855c-56de3c87a7d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.221332 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.221187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c102c78-43aa-4aae-855c-56de3c87a7d4-data-volume\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.221332 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.221264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c102c78-43aa-4aae-855c-56de3c87a7d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322341 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322301 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c102c78-43aa-4aae-855c-56de3c87a7d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322341 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322346 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c102c78-43aa-4aae-855c-56de3c87a7d4-crio-socket\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322590 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c102c78-43aa-4aae-855c-56de3c87a7d4-crio-socket\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322590 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322431 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rx4v9\" (UniqueName: \"kubernetes.io/projected/0c102c78-43aa-4aae-855c-56de3c87a7d4-kube-api-access-rx4v9\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322590 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322456 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c102c78-43aa-4aae-855c-56de3c87a7d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322590 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:05:56.322457 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 16:05:56.322590 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322479 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c102c78-43aa-4aae-855c-56de3c87a7d4-data-volume\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.322590 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:05:56.322527 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c102c78-43aa-4aae-855c-56de3c87a7d4-insights-runtime-extractor-tls podName:0c102c78-43aa-4aae-855c-56de3c87a7d4 nodeName:}" failed. No retries permitted until 2026-05-28 16:05:56.822506623 +0000 UTC m=+175.305029491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c102c78-43aa-4aae-855c-56de3c87a7d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hgdz7" (UID: "0c102c78-43aa-4aae-855c-56de3c87a7d4") : secret "insights-runtime-extractor-tls" not found May 28 16:05:56.322944 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.322925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c102c78-43aa-4aae-855c-56de3c87a7d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.323430 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.323414 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c102c78-43aa-4aae-855c-56de3c87a7d4-data-volume\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.330650 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.330624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx4v9\" (UniqueName: \"kubernetes.io/projected/0c102c78-43aa-4aae-855c-56de3c87a7d4-kube-api-access-rx4v9\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.827232 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.827191 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c102c78-43aa-4aae-855c-56de3c87a7d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:56.829478 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:56.829458 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c102c78-43aa-4aae-855c-56de3c87a7d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgdz7\" (UID: \"0c102c78-43aa-4aae-855c-56de3c87a7d4\") " pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:57.024307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:57.024274 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hgdz7" May 28 16:05:57.145594 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:57.145560 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hgdz7"] May 28 16:05:57.149159 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:05:57.149129 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c102c78_43aa_4aae_855c_56de3c87a7d4.slice/crio-c898a5b58f1e9d611398d6ae10f09c3f20da3d36f4d81e0bcf4daf137344beb0 WatchSource:0}: Error finding container c898a5b58f1e9d611398d6ae10f09c3f20da3d36f4d81e0bcf4daf137344beb0: Status 404 returned error can't find the container with id c898a5b58f1e9d611398d6ae10f09c3f20da3d36f4d81e0bcf4daf137344beb0 May 28 16:05:57.663441 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:57.663403 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgdz7" event={"ID":"0c102c78-43aa-4aae-855c-56de3c87a7d4","Type":"ContainerStarted","Data":"a3f4ee683c2e08a3860cd2f584b75dfcc7fb76b06160df1dde7961a5f615714e"} May 28 16:05:57.663605 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:57.663449 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgdz7" event={"ID":"0c102c78-43aa-4aae-855c-56de3c87a7d4","Type":"ContainerStarted","Data":"c898a5b58f1e9d611398d6ae10f09c3f20da3d36f4d81e0bcf4daf137344beb0"} May 28 16:05:58.667698 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:58.667660 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgdz7" event={"ID":"0c102c78-43aa-4aae-855c-56de3c87a7d4","Type":"ContainerStarted","Data":"c51d839fa935d119ee28c9eced3e58c1f4d74848ca43700f4ca2b027a5298b83"} May 28 16:05:59.671835 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:59.671802 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgdz7" event={"ID":"0c102c78-43aa-4aae-855c-56de3c87a7d4","Type":"ContainerStarted","Data":"fc53e2824097856c595ba0b894f61f4f497a733ad53abcbd98aa33640306ecff"} May 28 16:05:59.691346 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:05:59.691299 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hgdz7" podStartSLOduration=1.713711628 podStartE2EDuration="3.691282958s" podCreationTimestamp="2026-05-28 16:05:56 +0000 UTC" firstStartedPulling="2026-05-28 16:05:57.202254302 +0000 UTC m=+175.684777176" lastFinishedPulling="2026-05-28 16:05:59.179825638 +0000 UTC m=+177.662348506" observedRunningTime="2026-05-28 16:05:59.689812893 +0000 UTC m=+178.172335784" watchObservedRunningTime="2026-05-28 16:05:59.691282958 +0000 UTC m=+178.173805847" May 28 16:07:34.220110 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.219998 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g"] May 28 16:07:34.222371 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.222355 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.225130 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.225105 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 16:07:34.225269 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.225137 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 16:07:34.226118 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.226060 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdf8f\"" May 28 16:07:34.231672 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.231648 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g"] May 28 16:07:34.364215 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.364180 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cv59\" (UniqueName: \"kubernetes.io/projected/09346f81-0ca1-42ba-bacb-493d86f76b86-kube-api-access-5cv59\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.364409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.364244 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.364409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.364274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.465554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.465521 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.465639 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.465559 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.465639 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.465590 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cv59\" (UniqueName: \"kubernetes.io/projected/09346f81-0ca1-42ba-bacb-493d86f76b86-kube-api-access-5cv59\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.466002 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.465979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.466038 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.465992 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.474400 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.474328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cv59\" (UniqueName: \"kubernetes.io/projected/09346f81-0ca1-42ba-bacb-493d86f76b86-kube-api-access-5cv59\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.531317 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.531275 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:34.661071 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.661033 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g"] May 28 16:07:34.664515 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:07:34.664483 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09346f81_0ca1_42ba_bacb_493d86f76b86.slice/crio-d24c3a4c235cdef8af2941a0f8abc467722e6a873f2a3f4445e61625555d1600 WatchSource:0}: Error finding container d24c3a4c235cdef8af2941a0f8abc467722e6a873f2a3f4445e61625555d1600: Status 404 returned error can't find the container with id d24c3a4c235cdef8af2941a0f8abc467722e6a873f2a3f4445e61625555d1600 May 28 16:07:34.901139 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:34.901085 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" event={"ID":"09346f81-0ca1-42ba-bacb-493d86f76b86","Type":"ContainerStarted","Data":"d24c3a4c235cdef8af2941a0f8abc467722e6a873f2a3f4445e61625555d1600"} May 28 16:07:42.922809 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:42.922770 2573 generic.go:358] "Generic (PLEG): container finished" podID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerID="d7b964cb3078cc7801f03ffef4ae887684db8ad8e09d77d1861468be4b929235" exitCode=0 May 28 16:07:42.923248 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:42.922828 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" event={"ID":"09346f81-0ca1-42ba-bacb-493d86f76b86","Type":"ContainerDied","Data":"d7b964cb3078cc7801f03ffef4ae887684db8ad8e09d77d1861468be4b929235"} May 28 16:07:45.930897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:45.930864 2573 generic.go:358] "Generic (PLEG): container finished" podID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerID="9bc12841acab59ab332ff52668bab6572944af214397b7eca92f5e408bcfa529" exitCode=0 May 28 16:07:45.931275 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:45.930924 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" event={"ID":"09346f81-0ca1-42ba-bacb-493d86f76b86","Type":"ContainerDied","Data":"9bc12841acab59ab332ff52668bab6572944af214397b7eca92f5e408bcfa529"} May 28 16:07:51.949018 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:51.948924 2573 generic.go:358] "Generic (PLEG): container finished" podID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerID="344fc90e06156156f8772adf0b0aed11138e19c4f357a76dff89a9b2fbf5ace3" exitCode=0 May 28 16:07:51.949018 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:51.949002 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" event={"ID":"09346f81-0ca1-42ba-bacb-493d86f76b86","Type":"ContainerDied","Data":"344fc90e06156156f8772adf0b0aed11138e19c4f357a76dff89a9b2fbf5ace3"} May 28 16:07:53.078360 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.078339 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:53.195075 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.195037 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-bundle\") pod \"09346f81-0ca1-42ba-bacb-493d86f76b86\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " May 28 16:07:53.195276 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.195113 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cv59\" (UniqueName: \"kubernetes.io/projected/09346f81-0ca1-42ba-bacb-493d86f76b86-kube-api-access-5cv59\") pod \"09346f81-0ca1-42ba-bacb-493d86f76b86\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " May 28 16:07:53.195276 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.195133 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-util\") pod \"09346f81-0ca1-42ba-bacb-493d86f76b86\" (UID: \"09346f81-0ca1-42ba-bacb-493d86f76b86\") " May 28 16:07:53.195745 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.195720 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-bundle" (OuterVolumeSpecName: "bundle") pod "09346f81-0ca1-42ba-bacb-493d86f76b86" (UID: "09346f81-0ca1-42ba-bacb-493d86f76b86"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:07:53.197284 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.197263 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09346f81-0ca1-42ba-bacb-493d86f76b86-kube-api-access-5cv59" (OuterVolumeSpecName: "kube-api-access-5cv59") pod "09346f81-0ca1-42ba-bacb-493d86f76b86" (UID: "09346f81-0ca1-42ba-bacb-493d86f76b86"). InnerVolumeSpecName "kube-api-access-5cv59". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:07:53.199617 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.199596 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-util" (OuterVolumeSpecName: "util") pod "09346f81-0ca1-42ba-bacb-493d86f76b86" (UID: "09346f81-0ca1-42ba-bacb-493d86f76b86"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:07:53.295769 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.295741 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cv59\" (UniqueName: \"kubernetes.io/projected/09346f81-0ca1-42ba-bacb-493d86f76b86-kube-api-access-5cv59\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:07:53.295769 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.295768 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:07:53.295943 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.295778 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09346f81-0ca1-42ba-bacb-493d86f76b86-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:07:53.955324 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.955286 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" event={"ID":"09346f81-0ca1-42ba-bacb-493d86f76b86","Type":"ContainerDied","Data":"d24c3a4c235cdef8af2941a0f8abc467722e6a873f2a3f4445e61625555d1600"} May 28 16:07:53.955324 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.955325 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d24c3a4c235cdef8af2941a0f8abc467722e6a873f2a3f4445e61625555d1600" May 28 16:07:53.955519 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:53.955325 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7v86g" May 28 16:07:56.979467 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979431 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257"] May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979666 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="pull" May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979677 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="pull" May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979686 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="extract" May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979692 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="extract" May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979699 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="util" May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979704 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="util" May 28 16:07:56.979842 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:56.979745 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="09346f81-0ca1-42ba-bacb-493d86f76b86" containerName="extract" May 28 16:07:57.021258 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.021229 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257"] May 28 16:07:57.021413 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.021349 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.025268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.025245 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 28 16:07:57.026026 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.026010 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 28 16:07:57.028478 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.028455 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qc78h\"" May 28 16:07:57.121640 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.121598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-5n257\" (UID: \"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.121868 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.121652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zskgp\" (UniqueName: \"kubernetes.io/projected/8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e-kube-api-access-zskgp\") pod \"cert-manager-operator-controller-manager-54b9655956-5n257\" (UID: \"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.222174 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.222131 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-5n257\" (UID: \"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.222355 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.222206 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zskgp\" (UniqueName: \"kubernetes.io/projected/8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e-kube-api-access-zskgp\") pod \"cert-manager-operator-controller-manager-54b9655956-5n257\" (UID: \"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.222542 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.222519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-5n257\" (UID: \"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.233380 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.233357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zskgp\" (UniqueName: \"kubernetes.io/projected/8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e-kube-api-access-zskgp\") pod \"cert-manager-operator-controller-manager-54b9655956-5n257\" (UID: \"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.330192 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.330158 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" May 28 16:07:57.456156 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.456120 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257"] May 28 16:07:57.461430 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:07:57.461400 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee3587a_a7d4_4ac0_976e_fb1f5402bd1e.slice/crio-9a568963fa1227fc6899654f0f5532a0abb6e3a137e2f3ae87f3efe892f13b67 WatchSource:0}: Error finding container 9a568963fa1227fc6899654f0f5532a0abb6e3a137e2f3ae87f3efe892f13b67: Status 404 returned error can't find the container with id 9a568963fa1227fc6899654f0f5532a0abb6e3a137e2f3ae87f3efe892f13b67 May 28 16:07:57.967437 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:57.967351 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" event={"ID":"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e","Type":"ContainerStarted","Data":"9a568963fa1227fc6899654f0f5532a0abb6e3a137e2f3ae87f3efe892f13b67"} May 28 16:07:59.977995 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:59.977909 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" event={"ID":"8ee3587a-a7d4-4ac0-976e-fb1f5402bd1e","Type":"ContainerStarted","Data":"c827801346a17d90d5464e54b1254e4a19662bff87521dc3cad1ad76091b9a4a"} May 28 16:07:59.998999 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:07:59.998828 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-5n257" podStartSLOduration=1.8283240090000001 podStartE2EDuration="3.998810038s" podCreationTimestamp="2026-05-28 16:07:56 +0000 UTC" firstStartedPulling="2026-05-28 16:07:57.463766731 +0000 UTC m=+295.946289598" lastFinishedPulling="2026-05-28 16:07:59.634252755 +0000 UTC m=+298.116775627" observedRunningTime="2026-05-28 16:07:59.997329665 +0000 UTC m=+298.479852548" watchObservedRunningTime="2026-05-28 16:07:59.998810038 +0000 UTC m=+298.481332928" May 28 16:08:01.110895 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.110859 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6"] May 28 16:08:01.112963 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.112943 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.115742 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.115709 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 16:08:01.115862 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.115816 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdf8f\"" May 28 16:08:01.116822 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.116804 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 16:08:01.124863 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.124833 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6"] May 28 16:08:01.253020 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.252965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k4s7\" (UniqueName: \"kubernetes.io/projected/8d6eaf09-da44-47f2-b987-69272bbe80fe-kube-api-access-4k4s7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.253020 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.253037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.253277 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.253056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.354402 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.354343 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.354402 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.354398 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.354671 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.354443 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k4s7\" (UniqueName: \"kubernetes.io/projected/8d6eaf09-da44-47f2-b987-69272bbe80fe-kube-api-access-4k4s7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.354818 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.354796 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.354879 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.354842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.368299 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.368251 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k4s7\" (UniqueName: \"kubernetes.io/projected/8d6eaf09-da44-47f2-b987-69272bbe80fe-kube-api-access-4k4s7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.421887 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.421848 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:01.546015 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.545990 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6"] May 28 16:08:01.548236 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:01.548212 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6eaf09_da44_47f2_b987_69272bbe80fe.slice/crio-12b8e55ba0b3bec7b6d3ca5530d1acb6012ad34f2369817cce04a9552c525f9e WatchSource:0}: Error finding container 12b8e55ba0b3bec7b6d3ca5530d1acb6012ad34f2369817cce04a9552c525f9e: Status 404 returned error can't find the container with id 12b8e55ba0b3bec7b6d3ca5530d1acb6012ad34f2369817cce04a9552c525f9e May 28 16:08:01.971320 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.971250 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:08:01.972596 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.972578 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:08:01.972912 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.972896 2573 kubelet.go:1628] "Image garbage collection succeeded" May 28 16:08:01.982945 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.982915 2573 generic.go:358] "Generic (PLEG): container finished" podID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerID="57d4183d6cf92348009001801d7807f602ee5eb85db490593fc5aeb09cf9c55e" exitCode=0 May 28 16:08:01.983052 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.982968 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" event={"ID":"8d6eaf09-da44-47f2-b987-69272bbe80fe","Type":"ContainerDied","Data":"57d4183d6cf92348009001801d7807f602ee5eb85db490593fc5aeb09cf9c55e"} May 28 16:08:01.983052 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:01.982992 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" event={"ID":"8d6eaf09-da44-47f2-b987-69272bbe80fe","Type":"ContainerStarted","Data":"12b8e55ba0b3bec7b6d3ca5530d1acb6012ad34f2369817cce04a9552c525f9e"} May 28 16:08:03.343671 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.343636 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jl255"] May 28 16:08:03.345983 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.345962 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.348699 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.348677 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 28 16:08:03.349875 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.349850 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b2brg\"" May 28 16:08:03.349981 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.349945 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 28 16:08:03.358352 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.358329 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jl255"] May 28 16:08:03.472320 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.472274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4zh\" (UniqueName: \"kubernetes.io/projected/f1f6bf44-65eb-45f4-8d3d-447ed306aadc-kube-api-access-2b4zh\") pod \"cert-manager-webhook-587ccfb98-jl255\" (UID: \"f1f6bf44-65eb-45f4-8d3d-447ed306aadc\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.472516 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.472403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f6bf44-65eb-45f4-8d3d-447ed306aadc-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jl255\" (UID: \"f1f6bf44-65eb-45f4-8d3d-447ed306aadc\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.573800 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.573754 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f6bf44-65eb-45f4-8d3d-447ed306aadc-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jl255\" (UID: \"f1f6bf44-65eb-45f4-8d3d-447ed306aadc\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.573994 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.573832 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4zh\" (UniqueName: \"kubernetes.io/projected/f1f6bf44-65eb-45f4-8d3d-447ed306aadc-kube-api-access-2b4zh\") pod \"cert-manager-webhook-587ccfb98-jl255\" (UID: \"f1f6bf44-65eb-45f4-8d3d-447ed306aadc\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.582772 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.582743 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1f6bf44-65eb-45f4-8d3d-447ed306aadc-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jl255\" (UID: \"f1f6bf44-65eb-45f4-8d3d-447ed306aadc\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.582931 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.582872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4zh\" (UniqueName: \"kubernetes.io/projected/f1f6bf44-65eb-45f4-8d3d-447ed306aadc-kube-api-access-2b4zh\") pod \"cert-manager-webhook-587ccfb98-jl255\" (UID: \"f1f6bf44-65eb-45f4-8d3d-447ed306aadc\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.665821 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.665741 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:03.805238 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:03.805207 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jl255"] May 28 16:08:04.461258 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:04.461212 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1f6bf44_65eb_45f4_8d3d_447ed306aadc.slice/crio-fabe3a7f26ab515be9c7db7c59506a7723913b345ff947e0de086e8a3159e9c0 WatchSource:0}: Error finding container fabe3a7f26ab515be9c7db7c59506a7723913b345ff947e0de086e8a3159e9c0: Status 404 returned error can't find the container with id fabe3a7f26ab515be9c7db7c59506a7723913b345ff947e0de086e8a3159e9c0 May 28 16:08:04.463608 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:04.463588 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:08:04.991922 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:04.991888 2573 generic.go:358] "Generic (PLEG): container finished" podID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerID="79c63793af3966f8607d041e71e77dfbbcadc85c9d9abcf3448a91714689d709" exitCode=0 May 28 16:08:04.992131 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:04.991965 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" event={"ID":"8d6eaf09-da44-47f2-b987-69272bbe80fe","Type":"ContainerDied","Data":"79c63793af3966f8607d041e71e77dfbbcadc85c9d9abcf3448a91714689d709"} May 28 16:08:04.993122 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:04.993081 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" event={"ID":"f1f6bf44-65eb-45f4-8d3d-447ed306aadc","Type":"ContainerStarted","Data":"fabe3a7f26ab515be9c7db7c59506a7723913b345ff947e0de086e8a3159e9c0"} May 28 16:08:05.998048 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:05.998012 2573 generic.go:358] "Generic (PLEG): container finished" podID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerID="3407909067fc47053bc05d8ae2fd31488a9c2878e98a065471aeacdfa3115452" exitCode=0 May 28 16:08:05.998512 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:05.998066 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" event={"ID":"8d6eaf09-da44-47f2-b987-69272bbe80fe","Type":"ContainerDied","Data":"3407909067fc47053bc05d8ae2fd31488a9c2878e98a065471aeacdfa3115452"} May 28 16:08:07.124203 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.124177 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:07.199511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.199464 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-bundle\") pod \"8d6eaf09-da44-47f2-b987-69272bbe80fe\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " May 28 16:08:07.199511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.199519 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-util\") pod \"8d6eaf09-da44-47f2-b987-69272bbe80fe\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " May 28 16:08:07.199728 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.199554 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k4s7\" (UniqueName: \"kubernetes.io/projected/8d6eaf09-da44-47f2-b987-69272bbe80fe-kube-api-access-4k4s7\") pod \"8d6eaf09-da44-47f2-b987-69272bbe80fe\" (UID: \"8d6eaf09-da44-47f2-b987-69272bbe80fe\") " May 28 16:08:07.199881 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.199850 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-bundle" (OuterVolumeSpecName: "bundle") pod "8d6eaf09-da44-47f2-b987-69272bbe80fe" (UID: "8d6eaf09-da44-47f2-b987-69272bbe80fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:07.201655 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.201630 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d6eaf09-da44-47f2-b987-69272bbe80fe-kube-api-access-4k4s7" (OuterVolumeSpecName: "kube-api-access-4k4s7") pod "8d6eaf09-da44-47f2-b987-69272bbe80fe" (UID: "8d6eaf09-da44-47f2-b987-69272bbe80fe"). InnerVolumeSpecName "kube-api-access-4k4s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:08:07.203437 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.203396 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-util" (OuterVolumeSpecName: "util") pod "8d6eaf09-da44-47f2-b987-69272bbe80fe" (UID: "8d6eaf09-da44-47f2-b987-69272bbe80fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:07.300086 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.300052 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k4s7\" (UniqueName: \"kubernetes.io/projected/8d6eaf09-da44-47f2-b987-69272bbe80fe-kube-api-access-4k4s7\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:07.300086 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.300082 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:07.300086 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:07.300104 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d6eaf09-da44-47f2-b987-69272bbe80fe-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:08.004895 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.004858 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" event={"ID":"8d6eaf09-da44-47f2-b987-69272bbe80fe","Type":"ContainerDied","Data":"12b8e55ba0b3bec7b6d3ca5530d1acb6012ad34f2369817cce04a9552c525f9e"} May 28 16:08:08.004895 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.004900 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12b8e55ba0b3bec7b6d3ca5530d1acb6012ad34f2369817cce04a9552c525f9e" May 28 16:08:08.005160 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.004876 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm9nw6" May 28 16:08:08.006169 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.006138 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" event={"ID":"f1f6bf44-65eb-45f4-8d3d-447ed306aadc","Type":"ContainerStarted","Data":"92b9eb60e34058c0b52973cc61b42356466fee08a23537b2322c9c6e920a5449"} May 28 16:08:08.006341 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.006328 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:08.163828 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.163772 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" podStartSLOduration=2.661881566 podStartE2EDuration="5.163754256s" podCreationTimestamp="2026-05-28 16:08:03 +0000 UTC" firstStartedPulling="2026-05-28 16:08:04.463714977 +0000 UTC m=+302.946237845" lastFinishedPulling="2026-05-28 16:08:06.965587662 +0000 UTC m=+305.448110535" observedRunningTime="2026-05-28 16:08:08.022900121 +0000 UTC m=+306.505423033" watchObservedRunningTime="2026-05-28 16:08:08.163754256 +0000 UTC m=+306.646277142" May 28 16:08:08.715806 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.715768 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cdlxn"] May 28 16:08:08.715992 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.715975 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="util" May 28 16:08:08.715992 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.715986 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="util" May 28 16:08:08.716076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.716001 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="pull" May 28 16:08:08.716076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.716006 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="pull" May 28 16:08:08.716076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.716012 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="extract" May 28 16:08:08.716076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.716018 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="extract" May 28 16:08:08.716076 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.716070 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d6eaf09-da44-47f2-b987-69272bbe80fe" containerName="extract" May 28 16:08:08.717986 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.717971 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:08.720361 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.720339 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nwtcf\"" May 28 16:08:08.727149 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.727124 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cdlxn"] May 28 16:08:08.808730 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.808689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7748be73-f6c0-4c1e-9779-89943c29c63f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cdlxn\" (UID: \"7748be73-f6c0-4c1e-9779-89943c29c63f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:08.808730 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.808728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftxt6\" (UniqueName: \"kubernetes.io/projected/7748be73-f6c0-4c1e-9779-89943c29c63f-kube-api-access-ftxt6\") pod \"cert-manager-cainjector-68b757865b-cdlxn\" (UID: \"7748be73-f6c0-4c1e-9779-89943c29c63f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:08.909770 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.909734 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7748be73-f6c0-4c1e-9779-89943c29c63f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cdlxn\" (UID: \"7748be73-f6c0-4c1e-9779-89943c29c63f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:08.909770 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.909774 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftxt6\" (UniqueName: \"kubernetes.io/projected/7748be73-f6c0-4c1e-9779-89943c29c63f-kube-api-access-ftxt6\") pod \"cert-manager-cainjector-68b757865b-cdlxn\" (UID: \"7748be73-f6c0-4c1e-9779-89943c29c63f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:08.918217 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.918175 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7748be73-f6c0-4c1e-9779-89943c29c63f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cdlxn\" (UID: \"7748be73-f6c0-4c1e-9779-89943c29c63f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:08.918387 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:08.918307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftxt6\" (UniqueName: \"kubernetes.io/projected/7748be73-f6c0-4c1e-9779-89943c29c63f-kube-api-access-ftxt6\") pod \"cert-manager-cainjector-68b757865b-cdlxn\" (UID: \"7748be73-f6c0-4c1e-9779-89943c29c63f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:09.026104 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:09.026077 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" May 28 16:08:09.145172 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:09.145148 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cdlxn"] May 28 16:08:09.147695 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:09.147664 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7748be73_f6c0_4c1e_9779_89943c29c63f.slice/crio-6a274e613e37fe0a722a18d406c9cb103c6b74f04bdbfd927129e504d0fea9ea WatchSource:0}: Error finding container 6a274e613e37fe0a722a18d406c9cb103c6b74f04bdbfd927129e504d0fea9ea: Status 404 returned error can't find the container with id 6a274e613e37fe0a722a18d406c9cb103c6b74f04bdbfd927129e504d0fea9ea May 28 16:08:10.012295 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:10.012265 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" event={"ID":"7748be73-f6c0-4c1e-9779-89943c29c63f","Type":"ContainerStarted","Data":"b772d36cb445f7579b00b5f24e8bc05c29bb51ade378b1b0eb078b4c71d53bd9"} May 28 16:08:10.012295 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:10.012298 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" event={"ID":"7748be73-f6c0-4c1e-9779-89943c29c63f","Type":"ContainerStarted","Data":"6a274e613e37fe0a722a18d406c9cb103c6b74f04bdbfd927129e504d0fea9ea"} May 28 16:08:10.027698 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:10.027640 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-cdlxn" podStartSLOduration=2.02762453 podStartE2EDuration="2.02762453s" podCreationTimestamp="2026-05-28 16:08:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:08:10.02712471 +0000 UTC m=+308.509647592" watchObservedRunningTime="2026-05-28 16:08:10.02762453 +0000 UTC m=+308.510147420" May 28 16:08:13.906695 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.906659 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p"] May 28 16:08:13.909206 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.909183 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:13.912008 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.911986 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 16:08:13.912649 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.912630 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 16:08:13.912748 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.912637 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dmfr4\"" May 28 16:08:13.921497 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.921474 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p"] May 28 16:08:13.944263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.940869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217e09c9-7d01-4bc7-9403-4228e59471a4-tmp\") pod \"openshift-lws-operator-bfc7f696d-jh27p\" (UID: \"217e09c9-7d01-4bc7-9403-4228e59471a4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:13.944263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:13.941036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp25h\" (UniqueName: \"kubernetes.io/projected/217e09c9-7d01-4bc7-9403-4228e59471a4-kube-api-access-mp25h\") pod \"openshift-lws-operator-bfc7f696d-jh27p\" (UID: \"217e09c9-7d01-4bc7-9403-4228e59471a4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:14.010746 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.010719 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jl255" May 28 16:08:14.042251 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.042212 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217e09c9-7d01-4bc7-9403-4228e59471a4-tmp\") pod \"openshift-lws-operator-bfc7f696d-jh27p\" (UID: \"217e09c9-7d01-4bc7-9403-4228e59471a4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:14.042429 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.042359 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mp25h\" (UniqueName: \"kubernetes.io/projected/217e09c9-7d01-4bc7-9403-4228e59471a4-kube-api-access-mp25h\") pod \"openshift-lws-operator-bfc7f696d-jh27p\" (UID: \"217e09c9-7d01-4bc7-9403-4228e59471a4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:14.042624 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.042599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217e09c9-7d01-4bc7-9403-4228e59471a4-tmp\") pod \"openshift-lws-operator-bfc7f696d-jh27p\" (UID: \"217e09c9-7d01-4bc7-9403-4228e59471a4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:14.050419 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.050378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp25h\" (UniqueName: \"kubernetes.io/projected/217e09c9-7d01-4bc7-9403-4228e59471a4-kube-api-access-mp25h\") pod \"openshift-lws-operator-bfc7f696d-jh27p\" (UID: \"217e09c9-7d01-4bc7-9403-4228e59471a4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:14.218184 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.218083 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" May 28 16:08:14.340878 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:14.340840 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p"] May 28 16:08:14.345248 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:14.345217 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod217e09c9_7d01_4bc7_9403_4228e59471a4.slice/crio-b03b44d8ef04f508341101d6bfbfb934b96727cb2e7bbd4560cb5f67e2580c1e WatchSource:0}: Error finding container b03b44d8ef04f508341101d6bfbfb934b96727cb2e7bbd4560cb5f67e2580c1e: Status 404 returned error can't find the container with id b03b44d8ef04f508341101d6bfbfb934b96727cb2e7bbd4560cb5f67e2580c1e May 28 16:08:15.027227 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:15.027190 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" event={"ID":"217e09c9-7d01-4bc7-9403-4228e59471a4","Type":"ContainerStarted","Data":"b03b44d8ef04f508341101d6bfbfb934b96727cb2e7bbd4560cb5f67e2580c1e"} May 28 16:08:17.034538 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:17.034503 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" event={"ID":"217e09c9-7d01-4bc7-9403-4228e59471a4","Type":"ContainerStarted","Data":"aa157f8c0b635f6d60007b72df90ef7e38ab2b233f458dbfddea9142fa6d9299"} May 28 16:08:17.053433 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:17.053377 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jh27p" podStartSLOduration=1.459114214 podStartE2EDuration="4.053357543s" podCreationTimestamp="2026-05-28 16:08:13 +0000 UTC" firstStartedPulling="2026-05-28 16:08:14.346610916 +0000 UTC m=+312.829133789" lastFinishedPulling="2026-05-28 16:08:16.940854245 +0000 UTC m=+315.423377118" observedRunningTime="2026-05-28 16:08:17.051521684 +0000 UTC m=+315.534044574" watchObservedRunningTime="2026-05-28 16:08:17.053357543 +0000 UTC m=+315.535880432" May 28 16:08:20.028174 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.028126 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh"] May 28 16:08:20.030299 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.030282 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.032905 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.032884 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 16:08:20.033911 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.033887 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdf8f\"" May 28 16:08:20.033994 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.033887 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 16:08:20.038930 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.038900 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh"] May 28 16:08:20.080694 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.080659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbn7\" (UniqueName: \"kubernetes.io/projected/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-kube-api-access-wjbn7\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.080694 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.080700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.080951 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.080726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.181837 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.181793 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbn7\" (UniqueName: \"kubernetes.io/projected/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-kube-api-access-wjbn7\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.181837 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.181840 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.182120 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.181875 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.182337 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.182316 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.182406 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.182333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.190508 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.190486 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbn7\" (UniqueName: \"kubernetes.io/projected/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-kube-api-access-wjbn7\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.339335 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.339240 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:20.465407 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:20.465254 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh"] May 28 16:08:20.467506 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:20.467479 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f657562_bddf_43b8_8aeb_7a17a6cc2abf.slice/crio-0259c60376dae6cb6eafb1a08819426e4fb720e3cd56cbba5fb82c9b8291d965 WatchSource:0}: Error finding container 0259c60376dae6cb6eafb1a08819426e4fb720e3cd56cbba5fb82c9b8291d965: Status 404 returned error can't find the container with id 0259c60376dae6cb6eafb1a08819426e4fb720e3cd56cbba5fb82c9b8291d965 May 28 16:08:21.049494 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:21.049456 2573 generic.go:358] "Generic (PLEG): container finished" podID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerID="1e0d76d289467d5a19311e5c85ee2f96c6d502fc666d97659643d30674de9e27" exitCode=0 May 28 16:08:21.049898 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:21.049543 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" event={"ID":"3f657562-bddf-43b8-8aeb-7a17a6cc2abf","Type":"ContainerDied","Data":"1e0d76d289467d5a19311e5c85ee2f96c6d502fc666d97659643d30674de9e27"} May 28 16:08:21.049898 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:21.049579 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" event={"ID":"3f657562-bddf-43b8-8aeb-7a17a6cc2abf","Type":"ContainerStarted","Data":"0259c60376dae6cb6eafb1a08819426e4fb720e3cd56cbba5fb82c9b8291d965"} May 28 16:08:22.238869 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.238836 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dsktd"] May 28 16:08:22.254903 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.254873 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dsktd"] May 28 16:08:22.255017 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.254980 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.257717 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.257696 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fhn6w\"" May 28 16:08:22.297075 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.297043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb58m\" (UniqueName: \"kubernetes.io/projected/4df0e15c-7581-42fa-858f-abcbf7280a23-kube-api-access-vb58m\") pod \"cert-manager-79c8d999ff-dsktd\" (UID: \"4df0e15c-7581-42fa-858f-abcbf7280a23\") " pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.297234 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.297125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df0e15c-7581-42fa-858f-abcbf7280a23-bound-sa-token\") pod \"cert-manager-79c8d999ff-dsktd\" (UID: \"4df0e15c-7581-42fa-858f-abcbf7280a23\") " pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.397545 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.397496 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df0e15c-7581-42fa-858f-abcbf7280a23-bound-sa-token\") pod \"cert-manager-79c8d999ff-dsktd\" (UID: \"4df0e15c-7581-42fa-858f-abcbf7280a23\") " pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.397702 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.397610 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vb58m\" (UniqueName: \"kubernetes.io/projected/4df0e15c-7581-42fa-858f-abcbf7280a23-kube-api-access-vb58m\") pod \"cert-manager-79c8d999ff-dsktd\" (UID: \"4df0e15c-7581-42fa-858f-abcbf7280a23\") " pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.406670 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.406628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4df0e15c-7581-42fa-858f-abcbf7280a23-bound-sa-token\") pod \"cert-manager-79c8d999ff-dsktd\" (UID: \"4df0e15c-7581-42fa-858f-abcbf7280a23\") " pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.406798 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.406774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb58m\" (UniqueName: \"kubernetes.io/projected/4df0e15c-7581-42fa-858f-abcbf7280a23-kube-api-access-vb58m\") pod \"cert-manager-79c8d999ff-dsktd\" (UID: \"4df0e15c-7581-42fa-858f-abcbf7280a23\") " pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.563798 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.563700 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-dsktd" May 28 16:08:22.688643 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:22.688617 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-dsktd"] May 28 16:08:22.691284 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:22.691250 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4df0e15c_7581_42fa_858f_abcbf7280a23.slice/crio-9898942b085645fd5382fe564c3a376aeff613e335694fd3fd19ad9e34f395ea WatchSource:0}: Error finding container 9898942b085645fd5382fe564c3a376aeff613e335694fd3fd19ad9e34f395ea: Status 404 returned error can't find the container with id 9898942b085645fd5382fe564c3a376aeff613e335694fd3fd19ad9e34f395ea May 28 16:08:23.057840 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:23.057800 2573 generic.go:358] "Generic (PLEG): container finished" podID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerID="31f2a2bda0386c31cf5227d1a479435271d2b08cddfdfd1db25f3c0aef548164" exitCode=0 May 28 16:08:23.058040 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:23.057874 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" event={"ID":"3f657562-bddf-43b8-8aeb-7a17a6cc2abf","Type":"ContainerDied","Data":"31f2a2bda0386c31cf5227d1a479435271d2b08cddfdfd1db25f3c0aef548164"} May 28 16:08:23.059415 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:23.059381 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-dsktd" event={"ID":"4df0e15c-7581-42fa-858f-abcbf7280a23","Type":"ContainerStarted","Data":"21b9b6e41d395f0c009cc4d18658b5ba2d488355808f6e521bbc566ee8a575df"} May 28 16:08:23.059522 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:23.059419 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-dsktd" event={"ID":"4df0e15c-7581-42fa-858f-abcbf7280a23","Type":"ContainerStarted","Data":"9898942b085645fd5382fe564c3a376aeff613e335694fd3fd19ad9e34f395ea"} May 28 16:08:23.089776 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:23.089735 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-dsktd" podStartSLOduration=1.08972218 podStartE2EDuration="1.08972218s" podCreationTimestamp="2026-05-28 16:08:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:08:23.088048889 +0000 UTC m=+321.570571779" watchObservedRunningTime="2026-05-28 16:08:23.08972218 +0000 UTC m=+321.572245071" May 28 16:08:24.064626 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:24.064592 2573 generic.go:358] "Generic (PLEG): container finished" podID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerID="25d7f7452e745300519b356cb70759538180a52682bc2ee247bd3bbf85e9d07f" exitCode=0 May 28 16:08:24.064987 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:24.064688 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" event={"ID":"3f657562-bddf-43b8-8aeb-7a17a6cc2abf","Type":"ContainerDied","Data":"25d7f7452e745300519b356cb70759538180a52682bc2ee247bd3bbf85e9d07f"} May 28 16:08:25.190732 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.190703 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:25.215775 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.215747 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-util\") pod \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " May 28 16:08:25.215941 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.215803 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-bundle\") pod \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " May 28 16:08:25.215941 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.215867 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjbn7\" (UniqueName: \"kubernetes.io/projected/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-kube-api-access-wjbn7\") pod \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\" (UID: \"3f657562-bddf-43b8-8aeb-7a17a6cc2abf\") " May 28 16:08:25.216645 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.216613 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-bundle" (OuterVolumeSpecName: "bundle") pod "3f657562-bddf-43b8-8aeb-7a17a6cc2abf" (UID: "3f657562-bddf-43b8-8aeb-7a17a6cc2abf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:25.218187 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.218161 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-kube-api-access-wjbn7" (OuterVolumeSpecName: "kube-api-access-wjbn7") pod "3f657562-bddf-43b8-8aeb-7a17a6cc2abf" (UID: "3f657562-bddf-43b8-8aeb-7a17a6cc2abf"). InnerVolumeSpecName "kube-api-access-wjbn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:08:25.223747 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.223718 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-util" (OuterVolumeSpecName: "util") pod "3f657562-bddf-43b8-8aeb-7a17a6cc2abf" (UID: "3f657562-bddf-43b8-8aeb-7a17a6cc2abf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:25.316985 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.316947 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:25.316985 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.316978 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:25.316985 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:25.316990 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjbn7\" (UniqueName: \"kubernetes.io/projected/3f657562-bddf-43b8-8aeb-7a17a6cc2abf-kube-api-access-wjbn7\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:26.072840 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:26.072801 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" event={"ID":"3f657562-bddf-43b8-8aeb-7a17a6cc2abf","Type":"ContainerDied","Data":"0259c60376dae6cb6eafb1a08819426e4fb720e3cd56cbba5fb82c9b8291d965"} May 28 16:08:26.072840 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:26.072841 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0259c60376dae6cb6eafb1a08819426e4fb720e3cd56cbba5fb82c9b8291d965" May 28 16:08:26.073047 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:26.072864 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c57tfvh" May 28 16:08:32.478061 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478021 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc"] May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478349 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="pull" May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478368 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="pull" May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478378 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="extract" May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478387 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="extract" May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478403 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="util" May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478413 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="util" May 28 16:08:32.478662 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.478481 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f657562-bddf-43b8-8aeb-7a17a6cc2abf" containerName="extract" May 28 16:08:32.481036 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.481013 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.484422 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.484399 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 16:08:32.484537 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.484424 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 16:08:32.486237 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.486221 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdf8f\"" May 28 16:08:32.495365 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.495338 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc"] May 28 16:08:32.560862 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.560824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.560862 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.560866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.561087 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.560894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4snx\" (UniqueName: \"kubernetes.io/projected/60c71b43-d729-4964-8773-979c7d6b849f-kube-api-access-f4snx\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.662159 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.662123 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.662356 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.662168 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.662356 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.662188 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4snx\" (UniqueName: \"kubernetes.io/projected/60c71b43-d729-4964-8773-979c7d6b849f-kube-api-access-f4snx\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.662597 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.662574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.662677 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.662584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.673579 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.673549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4snx\" (UniqueName: \"kubernetes.io/projected/60c71b43-d729-4964-8773-979c7d6b849f-kube-api-access-f4snx\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.789669 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.789638 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:32.951732 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:32.951701 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc"] May 28 16:08:32.954864 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:32.954835 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c71b43_d729_4964_8773_979c7d6b849f.slice/crio-462062853bfffcd63286986cf53c15801dc3bde66abfa7eac5676ab0153a5e28 WatchSource:0}: Error finding container 462062853bfffcd63286986cf53c15801dc3bde66abfa7eac5676ab0153a5e28: Status 404 returned error can't find the container with id 462062853bfffcd63286986cf53c15801dc3bde66abfa7eac5676ab0153a5e28 May 28 16:08:33.093974 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:33.093940 2573 generic.go:358] "Generic (PLEG): container finished" podID="60c71b43-d729-4964-8773-979c7d6b849f" containerID="f044750ddaf18e79be1970a38ebbd5a162b8ba933e19d260e267223a7fa8dc38" exitCode=0 May 28 16:08:33.094131 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:33.094019 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" event={"ID":"60c71b43-d729-4964-8773-979c7d6b849f","Type":"ContainerDied","Data":"f044750ddaf18e79be1970a38ebbd5a162b8ba933e19d260e267223a7fa8dc38"} May 28 16:08:33.094131 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:33.094051 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" event={"ID":"60c71b43-d729-4964-8773-979c7d6b849f","Type":"ContainerStarted","Data":"462062853bfffcd63286986cf53c15801dc3bde66abfa7eac5676ab0153a5e28"} May 28 16:08:34.098693 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.098654 2573 generic.go:358] "Generic (PLEG): container finished" podID="60c71b43-d729-4964-8773-979c7d6b849f" containerID="5a9c3cb7c5c372f734209a4d1e8418b744c2ee39bb81b281fc24a6bdf12c40f1" exitCode=0 May 28 16:08:34.099085 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.098706 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" event={"ID":"60c71b43-d729-4964-8773-979c7d6b849f","Type":"ContainerDied","Data":"5a9c3cb7c5c372f734209a4d1e8418b744c2ee39bb81b281fc24a6bdf12c40f1"} May 28 16:08:34.906424 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.906388 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn"] May 28 16:08:34.909492 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.909465 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:34.915649 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.915493 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 16:08:34.915649 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.915604 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 16:08:34.916655 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.916631 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 16:08:34.916826 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.916740 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 16:08:34.916826 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.916754 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jvznl\"" May 28 16:08:34.946167 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.946128 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn"] May 28 16:08:34.978003 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.977969 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bb68819-2a08-4172-a39d-a8497922d165-webhook-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:34.978003 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.978006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8bb68819-2a08-4172-a39d-a8497922d165-apiservice-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:34.978273 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:34.978033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gs59\" (UniqueName: \"kubernetes.io/projected/8bb68819-2a08-4172-a39d-a8497922d165-kube-api-access-9gs59\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.078866 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.078831 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gs59\" (UniqueName: \"kubernetes.io/projected/8bb68819-2a08-4172-a39d-a8497922d165-kube-api-access-9gs59\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.079071 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.078901 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bb68819-2a08-4172-a39d-a8497922d165-webhook-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.079071 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.078929 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8bb68819-2a08-4172-a39d-a8497922d165-apiservice-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.081477 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.081453 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bb68819-2a08-4172-a39d-a8497922d165-webhook-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.081573 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.081519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8bb68819-2a08-4172-a39d-a8497922d165-apiservice-cert\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.104893 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.104852 2573 generic.go:358] "Generic (PLEG): container finished" podID="60c71b43-d729-4964-8773-979c7d6b849f" containerID="652730dae3e73b9aa7c8149fddd5e6d4901a2bb03b76df57dc43eba27aa3f9e1" exitCode=0 May 28 16:08:35.105256 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.104933 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" event={"ID":"60c71b43-d729-4964-8773-979c7d6b849f","Type":"ContainerDied","Data":"652730dae3e73b9aa7c8149fddd5e6d4901a2bb03b76df57dc43eba27aa3f9e1"} May 28 16:08:35.106914 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.106888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gs59\" (UniqueName: \"kubernetes.io/projected/8bb68819-2a08-4172-a39d-a8497922d165-kube-api-access-9gs59\") pod \"opendatahub-operator-controller-manager-864b4b584-96rmn\" (UID: \"8bb68819-2a08-4172-a39d-a8497922d165\") " pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.219611 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.219511 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:35.374508 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:35.374475 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn"] May 28 16:08:35.378232 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:35.378203 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb68819_2a08_4172_a39d_a8497922d165.slice/crio-08c029999148f9948a249715f67c56281727a535ca49ebf1e8eba41af5db172c WatchSource:0}: Error finding container 08c029999148f9948a249715f67c56281727a535ca49ebf1e8eba41af5db172c: Status 404 returned error can't find the container with id 08c029999148f9948a249715f67c56281727a535ca49ebf1e8eba41af5db172c May 28 16:08:36.109790 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.109749 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" event={"ID":"8bb68819-2a08-4172-a39d-a8497922d165","Type":"ContainerStarted","Data":"08c029999148f9948a249715f67c56281727a535ca49ebf1e8eba41af5db172c"} May 28 16:08:36.249409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.249380 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:36.288112 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.288046 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4snx\" (UniqueName: \"kubernetes.io/projected/60c71b43-d729-4964-8773-979c7d6b849f-kube-api-access-f4snx\") pod \"60c71b43-d729-4964-8773-979c7d6b849f\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " May 28 16:08:36.288233 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.288180 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-util\") pod \"60c71b43-d729-4964-8773-979c7d6b849f\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " May 28 16:08:36.288305 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.288268 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-bundle\") pod \"60c71b43-d729-4964-8773-979c7d6b849f\" (UID: \"60c71b43-d729-4964-8773-979c7d6b849f\") " May 28 16:08:36.289606 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.289573 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-bundle" (OuterVolumeSpecName: "bundle") pod "60c71b43-d729-4964-8773-979c7d6b849f" (UID: "60c71b43-d729-4964-8773-979c7d6b849f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:36.290627 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.290600 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c71b43-d729-4964-8773-979c7d6b849f-kube-api-access-f4snx" (OuterVolumeSpecName: "kube-api-access-f4snx") pod "60c71b43-d729-4964-8773-979c7d6b849f" (UID: "60c71b43-d729-4964-8773-979c7d6b849f"). InnerVolumeSpecName "kube-api-access-f4snx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:08:36.294951 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.294923 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-util" (OuterVolumeSpecName: "util") pod "60c71b43-d729-4964-8773-979c7d6b849f" (UID: "60c71b43-d729-4964-8773-979c7d6b849f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:36.389778 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.389654 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4snx\" (UniqueName: \"kubernetes.io/projected/60c71b43-d729-4964-8773-979c7d6b849f-kube-api-access-f4snx\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:36.389778 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.389693 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:36.389778 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:36.389710 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c71b43-d729-4964-8773-979c7d6b849f-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:37.114657 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:37.114617 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" event={"ID":"60c71b43-d729-4964-8773-979c7d6b849f","Type":"ContainerDied","Data":"462062853bfffcd63286986cf53c15801dc3bde66abfa7eac5676ab0153a5e28"} May 28 16:08:37.114657 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:37.114652 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="462062853bfffcd63286986cf53c15801dc3bde66abfa7eac5676ab0153a5e28" May 28 16:08:37.115151 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:37.114691 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gczmc" May 28 16:08:38.121607 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:38.121570 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" event={"ID":"8bb68819-2a08-4172-a39d-a8497922d165","Type":"ContainerStarted","Data":"7d9dc744bc146443fadb1b5962e8a29b3dad6e9e5e123f42f2429df83b3138b3"} May 28 16:08:38.121988 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:38.121760 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:38.146821 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:38.146760 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" podStartSLOduration=1.491440511 podStartE2EDuration="4.146745151s" podCreationTimestamp="2026-05-28 16:08:34 +0000 UTC" firstStartedPulling="2026-05-28 16:08:35.380044723 +0000 UTC m=+333.862567591" lastFinishedPulling="2026-05-28 16:08:38.03534936 +0000 UTC m=+336.517872231" observedRunningTime="2026-05-28 16:08:38.144629712 +0000 UTC m=+336.627152615" watchObservedRunningTime="2026-05-28 16:08:38.146745151 +0000 UTC m=+336.629268040" May 28 16:08:49.127002 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:49.126972 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-864b4b584-96rmn" May 28 16:08:51.633014 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.632939 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv"] May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633218 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="extract" May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633229 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="extract" May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633242 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="pull" May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633247 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="pull" May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633259 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="util" May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633265 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="util" May 28 16:08:51.633386 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.633304 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="60c71b43-d729-4964-8773-979c7d6b849f" containerName="extract" May 28 16:08:51.637248 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.637225 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.640903 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.640884 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdf8f\"" May 28 16:08:51.641208 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.641193 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 16:08:51.641858 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.641837 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 16:08:51.651908 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.651887 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv"] May 28 16:08:51.699761 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.699736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sns68\" (UniqueName: \"kubernetes.io/projected/d146d393-0e3d-4ae3-94d9-c5d5784037e5-kube-api-access-sns68\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.699896 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.699778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.699945 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.699893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.801245 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.801205 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.801428 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.801254 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sns68\" (UniqueName: \"kubernetes.io/projected/d146d393-0e3d-4ae3-94d9-c5d5784037e5-kube-api-access-sns68\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.801428 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.801371 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.801616 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.801599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.801682 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.801665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.811574 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.811546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sns68\" (UniqueName: \"kubernetes.io/projected/d146d393-0e3d-4ae3-94d9-c5d5784037e5-kube-api-access-sns68\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:51.946670 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:51.946588 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:52.084747 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:52.084711 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv"] May 28 16:08:52.088461 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:52.088426 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd146d393_0e3d_4ae3_94d9_c5d5784037e5.slice/crio-e1556e9ab8012b3050b3d06ed430457bcafdfd862b4ee488c53124917f846bbe WatchSource:0}: Error finding container e1556e9ab8012b3050b3d06ed430457bcafdfd862b4ee488c53124917f846bbe: Status 404 returned error can't find the container with id e1556e9ab8012b3050b3d06ed430457bcafdfd862b4ee488c53124917f846bbe May 28 16:08:52.164966 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:52.164928 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" event={"ID":"d146d393-0e3d-4ae3-94d9-c5d5784037e5","Type":"ContainerStarted","Data":"0f9177a2b2d09fb3c5b478c586acc882e5819176ed5e864dd0a1a98af448c14c"} May 28 16:08:52.164966 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:52.164970 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" event={"ID":"d146d393-0e3d-4ae3-94d9-c5d5784037e5","Type":"ContainerStarted","Data":"e1556e9ab8012b3050b3d06ed430457bcafdfd862b4ee488c53124917f846bbe"} May 28 16:08:53.169233 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.169139 2573 generic.go:358] "Generic (PLEG): container finished" podID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerID="0f9177a2b2d09fb3c5b478c586acc882e5819176ed5e864dd0a1a98af448c14c" exitCode=0 May 28 16:08:53.169233 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.169185 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" event={"ID":"d146d393-0e3d-4ae3-94d9-c5d5784037e5","Type":"ContainerDied","Data":"0f9177a2b2d09fb3c5b478c586acc882e5819176ed5e864dd0a1a98af448c14c"} May 28 16:08:53.968328 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.968295 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6"] May 28 16:08:53.970347 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.970331 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:53.974845 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.974823 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 16:08:53.974845 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.974834 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 16:08:53.975049 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.974877 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9n9sr\"" May 28 16:08:53.975049 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.974826 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 16:08:53.983182 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:53.983162 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6"] May 28 16:08:54.016613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.016581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-manager-config\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.016739 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.016621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-metrics-cert\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.016739 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.016676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-cert\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.016739 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.016722 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k72hs\" (UniqueName: \"kubernetes.io/projected/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-kube-api-access-k72hs\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.117955 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.117919 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k72hs\" (UniqueName: \"kubernetes.io/projected/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-kube-api-access-k72hs\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.118144 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.117966 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-manager-config\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.118144 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.117993 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-metrics-cert\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.118144 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.118015 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-cert\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.118702 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.118675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-manager-config\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.120583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.120556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-cert\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.120683 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.120556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-metrics-cert\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.127644 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.127619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k72hs\" (UniqueName: \"kubernetes.io/projected/2f4c7b19-ac2b-495e-ad45-ac9fd4383116-kube-api-access-k72hs\") pod \"lws-controller-manager-64d695c68d-t4nf6\" (UID: \"2f4c7b19-ac2b-495e-ad45-ac9fd4383116\") " pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.279652 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.279617 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:54.461661 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:54.461627 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6"] May 28 16:08:54.514928 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:54.514889 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4c7b19_ac2b_495e_ad45_ac9fd4383116.slice/crio-3200296326a2dbc844984d93bcafcc7828974d4269e81818ceea3dd2d3005c62 WatchSource:0}: Error finding container 3200296326a2dbc844984d93bcafcc7828974d4269e81818ceea3dd2d3005c62: Status 404 returned error can't find the container with id 3200296326a2dbc844984d93bcafcc7828974d4269e81818ceea3dd2d3005c62 May 28 16:08:55.176495 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.176448 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" event={"ID":"2f4c7b19-ac2b-495e-ad45-ac9fd4383116","Type":"ContainerStarted","Data":"3200296326a2dbc844984d93bcafcc7828974d4269e81818ceea3dd2d3005c62"} May 28 16:08:55.177928 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.177897 2573 generic.go:358] "Generic (PLEG): container finished" podID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerID="8f364a83ebe9b23c2de676ed302873aeb5be6a0cd9d9db257d0b7a18e83ff88e" exitCode=0 May 28 16:08:55.178055 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.177947 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" event={"ID":"d146d393-0e3d-4ae3-94d9-c5d5784037e5","Type":"ContainerDied","Data":"8f364a83ebe9b23c2de676ed302873aeb5be6a0cd9d9db257d0b7a18e83ff88e"} May 28 16:08:55.992525 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.992489 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-q6nhm"] May 28 16:08:55.994858 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.994831 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:55.997395 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.997373 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-z55tx\"" May 28 16:08:55.997395 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:55.997384 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 28 16:08:56.003177 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.003132 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-q6nhm"] May 28 16:08:56.032446 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.032414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq69l\" (UniqueName: \"kubernetes.io/projected/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-kube-api-access-kq69l\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:56.032651 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.032471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:56.133439 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.133397 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kq69l\" (UniqueName: \"kubernetes.io/projected/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-kube-api-access-kq69l\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:56.133627 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.133448 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:56.133680 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:08:56.133651 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 28 16:08:56.133734 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:08:56.133722 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert podName:f2365e29-bec3-48ba-8f1c-fb990e1d97e6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:56.633703124 +0000 UTC m=+355.116225995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert") pod "odh-model-controller-858dbf95b8-q6nhm" (UID: "f2365e29-bec3-48ba-8f1c-fb990e1d97e6") : secret "odh-model-controller-webhook-cert" not found May 28 16:08:56.142508 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.142471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq69l\" (UniqueName: \"kubernetes.io/projected/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-kube-api-access-kq69l\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:56.185438 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.185401 2573 generic.go:358] "Generic (PLEG): container finished" podID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerID="c6ecad8668ca20f88c45d76d98c52be93926473afd4d420ac84433e8985818ad" exitCode=0 May 28 16:08:56.185607 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.185467 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" event={"ID":"d146d393-0e3d-4ae3-94d9-c5d5784037e5","Type":"ContainerDied","Data":"c6ecad8668ca20f88c45d76d98c52be93926473afd4d420ac84433e8985818ad"} May 28 16:08:56.638709 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:56.638673 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:56.638883 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:08:56.638842 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 28 16:08:56.638932 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:08:56.638907 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert podName:f2365e29-bec3-48ba-8f1c-fb990e1d97e6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:57.638891913 +0000 UTC m=+356.121414780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert") pod "odh-model-controller-858dbf95b8-q6nhm" (UID: "f2365e29-bec3-48ba-8f1c-fb990e1d97e6") : secret "odh-model-controller-webhook-cert" not found May 28 16:08:57.190168 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.190130 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" event={"ID":"2f4c7b19-ac2b-495e-ad45-ac9fd4383116","Type":"ContainerStarted","Data":"fc15238f5a12a2b34a7ba44f4def829c64f6da375b535a52c72da8503dafeae5"} May 28 16:08:57.190612 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.190421 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:08:57.208547 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.208493 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" podStartSLOduration=2.308654693 podStartE2EDuration="4.208479612s" podCreationTimestamp="2026-05-28 16:08:53 +0000 UTC" firstStartedPulling="2026-05-28 16:08:54.516998392 +0000 UTC m=+352.999521263" lastFinishedPulling="2026-05-28 16:08:56.416823311 +0000 UTC m=+354.899346182" observedRunningTime="2026-05-28 16:08:57.206431428 +0000 UTC m=+355.688954318" watchObservedRunningTime="2026-05-28 16:08:57.208479612 +0000 UTC m=+355.691002499" May 28 16:08:57.313879 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.313851 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:57.346200 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.346165 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-util\") pod \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " May 28 16:08:57.346393 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.346293 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sns68\" (UniqueName: \"kubernetes.io/projected/d146d393-0e3d-4ae3-94d9-c5d5784037e5-kube-api-access-sns68\") pod \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " May 28 16:08:57.346393 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.346327 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-bundle\") pod \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\" (UID: \"d146d393-0e3d-4ae3-94d9-c5d5784037e5\") " May 28 16:08:57.347268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.347236 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-bundle" (OuterVolumeSpecName: "bundle") pod "d146d393-0e3d-4ae3-94d9-c5d5784037e5" (UID: "d146d393-0e3d-4ae3-94d9-c5d5784037e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:57.348499 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.348458 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d146d393-0e3d-4ae3-94d9-c5d5784037e5-kube-api-access-sns68" (OuterVolumeSpecName: "kube-api-access-sns68") pod "d146d393-0e3d-4ae3-94d9-c5d5784037e5" (UID: "d146d393-0e3d-4ae3-94d9-c5d5784037e5"). InnerVolumeSpecName "kube-api-access-sns68". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:08:57.354343 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.354301 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-util" (OuterVolumeSpecName: "util") pod "d146d393-0e3d-4ae3-94d9-c5d5784037e5" (UID: "d146d393-0e3d-4ae3-94d9-c5d5784037e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:08:57.447388 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.447294 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sns68\" (UniqueName: \"kubernetes.io/projected/d146d393-0e3d-4ae3-94d9-c5d5784037e5-kube-api-access-sns68\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:57.447388 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.447328 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:57.447388 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.447337 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d146d393-0e3d-4ae3-94d9-c5d5784037e5-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:08:57.649020 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.648996 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:57.651364 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.651347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2365e29-bec3-48ba-8f1c-fb990e1d97e6-cert\") pod \"odh-model-controller-858dbf95b8-q6nhm\" (UID: \"f2365e29-bec3-48ba-8f1c-fb990e1d97e6\") " pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:57.806225 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.806189 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:08:57.953963 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:57.953939 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-q6nhm"] May 28 16:08:57.956437 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:08:57.956407 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2365e29_bec3_48ba_8f1c_fb990e1d97e6.slice/crio-618ce8d41e021c8de22b4e288650fc6b28083a298920874a4d203e6cbc5d46aa WatchSource:0}: Error finding container 618ce8d41e021c8de22b4e288650fc6b28083a298920874a4d203e6cbc5d46aa: Status 404 returned error can't find the container with id 618ce8d41e021c8de22b4e288650fc6b28083a298920874a4d203e6cbc5d46aa May 28 16:08:58.194654 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:58.194628 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" May 28 16:08:58.195085 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:58.194625 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48354lcgv" event={"ID":"d146d393-0e3d-4ae3-94d9-c5d5784037e5","Type":"ContainerDied","Data":"e1556e9ab8012b3050b3d06ed430457bcafdfd862b4ee488c53124917f846bbe"} May 28 16:08:58.195085 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:58.194750 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1556e9ab8012b3050b3d06ed430457bcafdfd862b4ee488c53124917f846bbe" May 28 16:08:58.195780 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:08:58.195746 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" event={"ID":"f2365e29-bec3-48ba-8f1c-fb990e1d97e6","Type":"ContainerStarted","Data":"618ce8d41e021c8de22b4e288650fc6b28083a298920874a4d203e6cbc5d46aa"} May 28 16:09:01.211718 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:01.209622 2573 generic.go:358] "Generic (PLEG): container finished" podID="f2365e29-bec3-48ba-8f1c-fb990e1d97e6" containerID="41924ec32b0551bb3b908679e12d3c8b6b1798fa20ce7aadc9a2ecae3d734b3d" exitCode=1 May 28 16:09:01.211718 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:01.209676 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" event={"ID":"f2365e29-bec3-48ba-8f1c-fb990e1d97e6","Type":"ContainerDied","Data":"41924ec32b0551bb3b908679e12d3c8b6b1798fa20ce7aadc9a2ecae3d734b3d"} May 28 16:09:01.211718 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:01.210007 2573 scope.go:117] "RemoveContainer" containerID="41924ec32b0551bb3b908679e12d3c8b6b1798fa20ce7aadc9a2ecae3d734b3d" May 28 16:09:02.214708 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:02.214670 2573 generic.go:358] "Generic (PLEG): container finished" podID="f2365e29-bec3-48ba-8f1c-fb990e1d97e6" containerID="f88276c16b844cd3e3240ca4860f3b27f212545c2cab0b08b5a44f6496c9dac9" exitCode=1 May 28 16:09:02.215145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:02.214756 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" event={"ID":"f2365e29-bec3-48ba-8f1c-fb990e1d97e6","Type":"ContainerDied","Data":"f88276c16b844cd3e3240ca4860f3b27f212545c2cab0b08b5a44f6496c9dac9"} May 28 16:09:02.215145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:02.214811 2573 scope.go:117] "RemoveContainer" containerID="41924ec32b0551bb3b908679e12d3c8b6b1798fa20ce7aadc9a2ecae3d734b3d" May 28 16:09:02.215145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:02.214998 2573 scope.go:117] "RemoveContainer" containerID="f88276c16b844cd3e3240ca4860f3b27f212545c2cab0b08b5a44f6496c9dac9" May 28 16:09:02.215264 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:09:02.215218 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-q6nhm_opendatahub(f2365e29-bec3-48ba-8f1c-fb990e1d97e6)\"" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" podUID="f2365e29-bec3-48ba-8f1c-fb990e1d97e6" May 28 16:09:03.219304 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:03.219280 2573 scope.go:117] "RemoveContainer" containerID="f88276c16b844cd3e3240ca4860f3b27f212545c2cab0b08b5a44f6496c9dac9" May 28 16:09:03.219743 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:09:03.219452 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-q6nhm_opendatahub(f2365e29-bec3-48ba-8f1c-fb990e1d97e6)\"" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" podUID="f2365e29-bec3-48ba-8f1c-fb990e1d97e6" May 28 16:09:05.824926 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.824885 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl"] May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825148 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="util" May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825158 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="util" May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825167 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="pull" May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825172 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="pull" May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825183 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="extract" May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825188 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="extract" May 28 16:09:05.825336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.825229 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d146d393-0e3d-4ae3-94d9-c5d5784037e5" containerName="extract" May 28 16:09:05.828304 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.828288 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:05.831155 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.831138 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 16:09:05.831262 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.831189 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdf8f\"" May 28 16:09:05.832205 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.832188 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 16:09:05.839196 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.839175 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl"] May 28 16:09:05.913185 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.913151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jlxs\" (UniqueName: \"kubernetes.io/projected/bfc2a052-e26c-40bf-ae8f-f765cde12377-kube-api-access-7jlxs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:05.913185 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.913189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:05.913469 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:05.913211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.014494 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.014460 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jlxs\" (UniqueName: \"kubernetes.io/projected/bfc2a052-e26c-40bf-ae8f-f765cde12377-kube-api-access-7jlxs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.014494 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.014497 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.014698 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.014527 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.014858 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.014839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.014915 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.014898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.024837 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.024811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jlxs\" (UniqueName: \"kubernetes.io/projected/bfc2a052-e26c-40bf-ae8f-f765cde12377-kube-api-access-7jlxs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.137008 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.136916 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:06.288172 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:06.288144 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl"] May 28 16:09:06.289403 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:09:06.289378 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc2a052_e26c_40bf_ae8f_f765cde12377.slice/crio-1eef99318cf12f6f4cbbc0d1635bd046a83093582daf5e6a5b45e776ef3db453 WatchSource:0}: Error finding container 1eef99318cf12f6f4cbbc0d1635bd046a83093582daf5e6a5b45e776ef3db453: Status 404 returned error can't find the container with id 1eef99318cf12f6f4cbbc0d1635bd046a83093582daf5e6a5b45e776ef3db453 May 28 16:09:07.046294 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.046261 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v"] May 28 16:09:07.049268 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.049246 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.052139 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.052116 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2vk6w\"" May 28 16:09:07.052260 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.052162 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 28 16:09:07.052260 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.052242 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 28 16:09:07.061496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.061471 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v"] May 28 16:09:07.125357 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.125320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/62b4214c-5710-4531-a457-e8aa79a02d16-operator-config\") pod \"servicemesh-operator3-55f49c5f94-2rv9v\" (UID: \"62b4214c-5710-4531-a457-e8aa79a02d16\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.125357 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.125357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhrg\" (UniqueName: \"kubernetes.io/projected/62b4214c-5710-4531-a457-e8aa79a02d16-kube-api-access-wmhrg\") pod \"servicemesh-operator3-55f49c5f94-2rv9v\" (UID: \"62b4214c-5710-4531-a457-e8aa79a02d16\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.226184 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.226144 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/62b4214c-5710-4531-a457-e8aa79a02d16-operator-config\") pod \"servicemesh-operator3-55f49c5f94-2rv9v\" (UID: \"62b4214c-5710-4531-a457-e8aa79a02d16\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.226184 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.226188 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhrg\" (UniqueName: \"kubernetes.io/projected/62b4214c-5710-4531-a457-e8aa79a02d16-kube-api-access-wmhrg\") pod \"servicemesh-operator3-55f49c5f94-2rv9v\" (UID: \"62b4214c-5710-4531-a457-e8aa79a02d16\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.228681 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.228656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/62b4214c-5710-4531-a457-e8aa79a02d16-operator-config\") pod \"servicemesh-operator3-55f49c5f94-2rv9v\" (UID: \"62b4214c-5710-4531-a457-e8aa79a02d16\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.237898 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.237843 2573 generic.go:358] "Generic (PLEG): container finished" podID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerID="7f66fba43a1dd480d366dffb6ee7c9b00358ff787482e756cc7b5ec95dad668f" exitCode=0 May 28 16:09:07.238016 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.237918 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" event={"ID":"bfc2a052-e26c-40bf-ae8f-f765cde12377","Type":"ContainerDied","Data":"7f66fba43a1dd480d366dffb6ee7c9b00358ff787482e756cc7b5ec95dad668f"} May 28 16:09:07.238016 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.237945 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" event={"ID":"bfc2a052-e26c-40bf-ae8f-f765cde12377","Type":"ContainerStarted","Data":"1eef99318cf12f6f4cbbc0d1635bd046a83093582daf5e6a5b45e776ef3db453"} May 28 16:09:07.239454 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.239431 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhrg\" (UniqueName: \"kubernetes.io/projected/62b4214c-5710-4531-a457-e8aa79a02d16-kube-api-access-wmhrg\") pod \"servicemesh-operator3-55f49c5f94-2rv9v\" (UID: \"62b4214c-5710-4531-a457-e8aa79a02d16\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.358547 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.358451 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:07.485911 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.485887 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v"] May 28 16:09:07.488241 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:09:07.488215 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b4214c_5710_4531_a457_e8aa79a02d16.slice/crio-dbcee16451a90a05cd26fa6a1d8702abf14e016d3c0b602e37b554799b6f752f WatchSource:0}: Error finding container dbcee16451a90a05cd26fa6a1d8702abf14e016d3c0b602e37b554799b6f752f: Status 404 returned error can't find the container with id dbcee16451a90a05cd26fa6a1d8702abf14e016d3c0b602e37b554799b6f752f May 28 16:09:07.807328 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.807288 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:09:07.807733 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:07.807718 2573 scope.go:117] "RemoveContainer" containerID="f88276c16b844cd3e3240ca4860f3b27f212545c2cab0b08b5a44f6496c9dac9" May 28 16:09:07.807915 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:09:07.807898 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-q6nhm_opendatahub(f2365e29-bec3-48ba-8f1c-fb990e1d97e6)\"" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" podUID="f2365e29-bec3-48ba-8f1c-fb990e1d97e6" May 28 16:09:08.198270 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:08.198174 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64d695c68d-t4nf6" May 28 16:09:08.246488 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:08.246438 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" event={"ID":"62b4214c-5710-4531-a457-e8aa79a02d16","Type":"ContainerStarted","Data":"dbcee16451a90a05cd26fa6a1d8702abf14e016d3c0b602e37b554799b6f752f"} May 28 16:09:09.251931 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:09.251895 2573 generic.go:358] "Generic (PLEG): container finished" podID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerID="be472784c43e042701659f1c2dd3cd0005de22098d330d140ca817de436e9be5" exitCode=0 May 28 16:09:09.252404 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:09.251947 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" event={"ID":"bfc2a052-e26c-40bf-ae8f-f765cde12377","Type":"ContainerDied","Data":"be472784c43e042701659f1c2dd3cd0005de22098d330d140ca817de436e9be5"} May 28 16:09:10.257803 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:10.257690 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" event={"ID":"62b4214c-5710-4531-a457-e8aa79a02d16","Type":"ContainerStarted","Data":"91a2a08161733cc613ea8a81f213b0908cc4d3695a5c843d44a5cd2f5c341c5e"} May 28 16:09:10.258256 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:10.257914 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:10.260109 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:10.260064 2573 generic.go:358] "Generic (PLEG): container finished" podID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerID="cb94fe0d68a2b0fcea41452ee270fc9b82adc58be3af078a3f20b65f7f7a9a26" exitCode=0 May 28 16:09:10.260241 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:10.260128 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" event={"ID":"bfc2a052-e26c-40bf-ae8f-f765cde12377","Type":"ContainerDied","Data":"cb94fe0d68a2b0fcea41452ee270fc9b82adc58be3af078a3f20b65f7f7a9a26"} May 28 16:09:10.280920 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:10.280858 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" podStartSLOduration=0.725560388 podStartE2EDuration="3.280842226s" podCreationTimestamp="2026-05-28 16:09:07 +0000 UTC" firstStartedPulling="2026-05-28 16:09:07.49076813 +0000 UTC m=+365.973290998" lastFinishedPulling="2026-05-28 16:09:10.046049952 +0000 UTC m=+368.528572836" observedRunningTime="2026-05-28 16:09:10.279374453 +0000 UTC m=+368.761897343" watchObservedRunningTime="2026-05-28 16:09:10.280842226 +0000 UTC m=+368.763365117" May 28 16:09:11.384749 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.384725 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:11.464357 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.464321 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-bundle\") pod \"bfc2a052-e26c-40bf-ae8f-f765cde12377\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " May 28 16:09:11.464519 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.464407 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jlxs\" (UniqueName: \"kubernetes.io/projected/bfc2a052-e26c-40bf-ae8f-f765cde12377-kube-api-access-7jlxs\") pod \"bfc2a052-e26c-40bf-ae8f-f765cde12377\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " May 28 16:09:11.464519 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.464437 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-util\") pod \"bfc2a052-e26c-40bf-ae8f-f765cde12377\" (UID: \"bfc2a052-e26c-40bf-ae8f-f765cde12377\") " May 28 16:09:11.465553 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.465518 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-bundle" (OuterVolumeSpecName: "bundle") pod "bfc2a052-e26c-40bf-ae8f-f765cde12377" (UID: "bfc2a052-e26c-40bf-ae8f-f765cde12377"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:11.466445 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.466424 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc2a052-e26c-40bf-ae8f-f765cde12377-kube-api-access-7jlxs" (OuterVolumeSpecName: "kube-api-access-7jlxs") pod "bfc2a052-e26c-40bf-ae8f-f765cde12377" (UID: "bfc2a052-e26c-40bf-ae8f-f765cde12377"). InnerVolumeSpecName "kube-api-access-7jlxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:09:11.472264 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.472236 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-util" (OuterVolumeSpecName: "util") pod "bfc2a052-e26c-40bf-ae8f-f765cde12377" (UID: "bfc2a052-e26c-40bf-ae8f-f765cde12377"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:09:11.565036 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.564940 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jlxs\" (UniqueName: \"kubernetes.io/projected/bfc2a052-e26c-40bf-ae8f-f765cde12377-kube-api-access-7jlxs\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:09:11.565036 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.564988 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:09:11.565036 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:11.565001 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfc2a052-e26c-40bf-ae8f-f765cde12377-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:09:12.269137 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:12.269079 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" event={"ID":"bfc2a052-e26c-40bf-ae8f-f765cde12377","Type":"ContainerDied","Data":"1eef99318cf12f6f4cbbc0d1635bd046a83093582daf5e6a5b45e776ef3db453"} May 28 16:09:12.269137 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:12.269134 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axxhhl" May 28 16:09:12.269343 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:12.269137 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eef99318cf12f6f4cbbc0d1635bd046a83093582daf5e6a5b45e776ef3db453" May 28 16:09:15.201211 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201175 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt"] May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201460 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="extract" May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201472 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="extract" May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201485 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="pull" May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201490 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="pull" May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201505 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="util" May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201511 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="util" May 28 16:09:15.201567 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.201551 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="bfc2a052-e26c-40bf-ae8f-f765cde12377" containerName="extract" May 28 16:09:15.207623 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.207602 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.210593 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.210567 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 28 16:09:15.210593 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.210584 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 28 16:09:15.210767 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.210620 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 16:09:15.210767 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.210634 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 16:09:15.210868 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.210790 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-csq29\"" May 28 16:09:15.211429 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.211415 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 16:09:15.211523 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.211417 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 28 16:09:15.218176 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.218154 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt"] May 28 16:09:15.293595 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25f8b\" (UniqueName: \"kubernetes.io/projected/bc747337-99cb-46bb-918e-2b231993bc90-kube-api-access-25f8b\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.293755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc747337-99cb-46bb-918e-2b231993bc90-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.293755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.293755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.293755 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc747337-99cb-46bb-918e-2b231993bc90-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.293909 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc747337-99cb-46bb-918e-2b231993bc90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.293909 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.293786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395145 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395084 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395158 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25f8b\" (UniqueName: \"kubernetes.io/projected/bc747337-99cb-46bb-918e-2b231993bc90-kube-api-access-25f8b\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395212 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc747337-99cb-46bb-918e-2b231993bc90-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395246 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395274 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395308 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc747337-99cb-46bb-918e-2b231993bc90-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395509 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395359 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc747337-99cb-46bb-918e-2b231993bc90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.395951 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.395925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc747337-99cb-46bb-918e-2b231993bc90-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.397614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.397589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc747337-99cb-46bb-918e-2b231993bc90-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.397707 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.397659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.398002 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.397981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.398002 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.397993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc747337-99cb-46bb-918e-2b231993bc90-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.407860 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.407831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc747337-99cb-46bb-918e-2b231993bc90-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.408042 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.408021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25f8b\" (UniqueName: \"kubernetes.io/projected/bc747337-99cb-46bb-918e-2b231993bc90-kube-api-access-25f8b\") pod \"istiod-openshift-gateway-798958bb55-5p8nt\" (UID: \"bc747337-99cb-46bb-918e-2b231993bc90\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.517753 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.517712 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:15.664313 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:15.664279 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt"] May 28 16:09:15.667572 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:09:15.667543 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc747337_99cb_46bb_918e_2b231993bc90.slice/crio-b5c9ce3bf93cff8baee3e642a2c17bb3229c6d4acc1e3de5acacf5fc92626ad2 WatchSource:0}: Error finding container b5c9ce3bf93cff8baee3e642a2c17bb3229c6d4acc1e3de5acacf5fc92626ad2: Status 404 returned error can't find the container with id b5c9ce3bf93cff8baee3e642a2c17bb3229c6d4acc1e3de5acacf5fc92626ad2 May 28 16:09:16.283443 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:16.283376 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" event={"ID":"bc747337-99cb-46bb-918e-2b231993bc90","Type":"ContainerStarted","Data":"b5c9ce3bf93cff8baee3e642a2c17bb3229c6d4acc1e3de5acacf5fc92626ad2"} May 28 16:09:17.807149 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:17.807119 2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:09:17.807566 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:17.807550 2573 scope.go:117] "RemoveContainer" containerID="f88276c16b844cd3e3240ca4860f3b27f212545c2cab0b08b5a44f6496c9dac9" May 28 16:09:18.480558 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:18.480509 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 16:09:18.480669 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:18.480604 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 16:09:19.297511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.297474 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" event={"ID":"f2365e29-bec3-48ba-8f1c-fb990e1d97e6","Type":"ContainerStarted","Data":"bfc57719d85a337f6771ece9b4c6b82f3a438b4f4f72feb4450a105c752aea77"} May 28 16:09:19.297951 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.297692 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:09:19.298937 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.298916 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" event={"ID":"bc747337-99cb-46bb-918e-2b231993bc90","Type":"ContainerStarted","Data":"8fd975bafbe7ee812f2b4071d243326db6430c4375c78ecaeadc4bb8a48ec0b5"} May 28 16:09:19.299147 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.299127 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:19.300919 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.300892 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-5p8nt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 28 16:09:19.301001 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.300977 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" podUID="bc747337-99cb-46bb-918e-2b231993bc90" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 16:09:19.314363 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.314326 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" podStartSLOduration=3.792269222 podStartE2EDuration="24.31431393s" podCreationTimestamp="2026-05-28 16:08:55 +0000 UTC" firstStartedPulling="2026-05-28 16:08:57.957763955 +0000 UTC m=+356.440286822" lastFinishedPulling="2026-05-28 16:09:18.479808647 +0000 UTC m=+376.962331530" observedRunningTime="2026-05-28 16:09:19.313021265 +0000 UTC m=+377.795544167" watchObservedRunningTime="2026-05-28 16:09:19.31431393 +0000 UTC m=+377.796836851" May 28 16:09:19.334686 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:19.334641 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" podStartSLOduration=1.5238559299999999 podStartE2EDuration="4.334625212s" podCreationTimestamp="2026-05-28 16:09:15 +0000 UTC" firstStartedPulling="2026-05-28 16:09:15.669496351 +0000 UTC m=+374.152019236" lastFinishedPulling="2026-05-28 16:09:18.480265635 +0000 UTC m=+376.962788518" observedRunningTime="2026-05-28 16:09:19.332338179 +0000 UTC m=+377.814861070" watchObservedRunningTime="2026-05-28 16:09:19.334625212 +0000 UTC m=+377.817148108" May 28 16:09:20.302809 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:20.302778 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5p8nt" May 28 16:09:21.265742 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:21.265707 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-2rv9v" May 28 16:09:30.304863 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:09:30.304830 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-q6nhm" May 28 16:10:05.920114 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.920059 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm"] May 28 16:10:05.923495 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.923470 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:05.925877 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.925856 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 16:10:05.926898 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.926879 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 16:10:05.927478 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.927463 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-57gqv\"" May 28 16:10:05.931336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.931314 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm"] May 28 16:10:05.965159 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.965123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:05.965337 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.965196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5cw6\" (UniqueName: \"kubernetes.io/projected/aec2f588-890c-44f9-8056-aa42af7c072a-kube-api-access-j5cw6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:05.965337 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:05.965218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.066304 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.066267 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.066463 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.066334 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5cw6\" (UniqueName: \"kubernetes.io/projected/aec2f588-890c-44f9-8056-aa42af7c072a-kube-api-access-j5cw6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.066463 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.066362 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.066730 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.066706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.066768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.066715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.085037 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.085010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5cw6\" (UniqueName: \"kubernetes.io/projected/aec2f588-890c-44f9-8056-aa42af7c072a-kube-api-access-j5cw6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.233303 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.233270 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:06.377609 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.377586 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm"] May 28 16:10:06.379349 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:10:06.379319 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec2f588_890c_44f9_8056_aa42af7c072a.slice/crio-4dd407c85bede72e864706138286f825c430aff7c0de38f84645c4265b6c70eb WatchSource:0}: Error finding container 4dd407c85bede72e864706138286f825c430aff7c0de38f84645c4265b6c70eb: Status 404 returned error can't find the container with id 4dd407c85bede72e864706138286f825c430aff7c0de38f84645c4265b6c70eb May 28 16:10:06.464047 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.464010 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" event={"ID":"aec2f588-890c-44f9-8056-aa42af7c072a","Type":"ContainerStarted","Data":"3a3bd154e26b010b3114e249cec31902a1152bdc7ef543eee80494eb3128a7f7"} May 28 16:10:06.464047 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.464051 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" event={"ID":"aec2f588-890c-44f9-8056-aa42af7c072a","Type":"ContainerStarted","Data":"4dd407c85bede72e864706138286f825c430aff7c0de38f84645c4265b6c70eb"} May 28 16:10:06.520681 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.520611 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh"] May 28 16:10:06.523653 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.523638 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.532624 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.532598 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh"] May 28 16:10:06.570531 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.570491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5mhw\" (UniqueName: \"kubernetes.io/projected/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-kube-api-access-s5mhw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.570709 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.570553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.570709 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.570583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.671201 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.671149 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.671376 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.671224 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.671376 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.671266 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5mhw\" (UniqueName: \"kubernetes.io/projected/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-kube-api-access-s5mhw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.671614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.671593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.671659 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.671604 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.679729 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.679704 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5mhw\" (UniqueName: \"kubernetes.io/projected/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-kube-api-access-s5mhw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.833030 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.832951 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:06.959707 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:06.959673 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh"] May 28 16:10:06.963052 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:10:06.963018 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685c55be_fd3f_4ecc_83f7_9cb46a6d94de.slice/crio-ffd9ad01431b998b79479d1a1278bd5161680ac13ec3d0f6f2d9f94feb334843 WatchSource:0}: Error finding container ffd9ad01431b998b79479d1a1278bd5161680ac13ec3d0f6f2d9f94feb334843: Status 404 returned error can't find the container with id ffd9ad01431b998b79479d1a1278bd5161680ac13ec3d0f6f2d9f94feb334843 May 28 16:10:07.120342 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.120305 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp"] May 28 16:10:07.123698 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.123679 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.138409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.138380 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp"] May 28 16:10:07.175511 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.175474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6mj\" (UniqueName: \"kubernetes.io/projected/08b1286a-0ac0-4dc6-8158-f692ea9cd432-kube-api-access-vg6mj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.175683 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.175527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.175683 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.175578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.276618 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.276584 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6mj\" (UniqueName: \"kubernetes.io/projected/08b1286a-0ac0-4dc6-8158-f692ea9cd432-kube-api-access-vg6mj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.276799 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.276631 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.276799 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.276666 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.276978 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.276964 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.277068 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.277048 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.284869 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.284833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6mj\" (UniqueName: \"kubernetes.io/projected/08b1286a-0ac0-4dc6-8158-f692ea9cd432-kube-api-access-vg6mj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.438086 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.437989 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:07.469090 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.469053 2573 generic.go:358] "Generic (PLEG): container finished" podID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerID="a782b405a73be355adbd1794d9e3329e9ca2ee4c14ee3a9416c80ec42c3c7fc2" exitCode=0 May 28 16:10:07.469307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.469123 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" event={"ID":"685c55be-fd3f-4ecc-83f7-9cb46a6d94de","Type":"ContainerDied","Data":"a782b405a73be355adbd1794d9e3329e9ca2ee4c14ee3a9416c80ec42c3c7fc2"} May 28 16:10:07.469307 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.469158 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" event={"ID":"685c55be-fd3f-4ecc-83f7-9cb46a6d94de","Type":"ContainerStarted","Data":"ffd9ad01431b998b79479d1a1278bd5161680ac13ec3d0f6f2d9f94feb334843"} May 28 16:10:07.470673 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.470647 2573 generic.go:358] "Generic (PLEG): container finished" podID="aec2f588-890c-44f9-8056-aa42af7c072a" containerID="3a3bd154e26b010b3114e249cec31902a1152bdc7ef543eee80494eb3128a7f7" exitCode=0 May 28 16:10:07.470807 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.470699 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" event={"ID":"aec2f588-890c-44f9-8056-aa42af7c072a","Type":"ContainerDied","Data":"3a3bd154e26b010b3114e249cec31902a1152bdc7ef543eee80494eb3128a7f7"} May 28 16:10:07.586071 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.586044 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp"] May 28 16:10:07.587921 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:10:07.587887 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b1286a_0ac0_4dc6_8158_f692ea9cd432.slice/crio-f281be387fdf9d4a33f873a0c8b5f9ac3c9e294cc0236c2fe9bd072657b3fb88 WatchSource:0}: Error finding container f281be387fdf9d4a33f873a0c8b5f9ac3c9e294cc0236c2fe9bd072657b3fb88: Status 404 returned error can't find the container with id f281be387fdf9d4a33f873a0c8b5f9ac3c9e294cc0236c2fe9bd072657b3fb88 May 28 16:10:07.719612 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.719520 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn"] May 28 16:10:07.722863 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.722841 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.730070 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.730042 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn"] May 28 16:10:07.780848 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.780809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzdc\" (UniqueName: \"kubernetes.io/projected/cbf10869-10cf-4cb1-8ebd-b8246665b64e-kube-api-access-qzzdc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.781029 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.780869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.781029 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.780893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.881474 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.881430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.881652 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.881481 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.881652 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.881555 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzdc\" (UniqueName: \"kubernetes.io/projected/cbf10869-10cf-4cb1-8ebd-b8246665b64e-kube-api-access-qzzdc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.881913 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.881891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.881952 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.881904 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:07.889807 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:07.889775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzdc\" (UniqueName: \"kubernetes.io/projected/cbf10869-10cf-4cb1-8ebd-b8246665b64e-kube-api-access-qzzdc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:08.052982 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.052949 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:08.394681 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.394569 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn"] May 28 16:10:08.438945 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:10:08.438910 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf10869_10cf_4cb1_8ebd_b8246665b64e.slice/crio-a4dde697312ff787c8f590d019873a3d6df2c8fb630b974c864d279228ffead4 WatchSource:0}: Error finding container a4dde697312ff787c8f590d019873a3d6df2c8fb630b974c864d279228ffead4: Status 404 returned error can't find the container with id a4dde697312ff787c8f590d019873a3d6df2c8fb630b974c864d279228ffead4 May 28 16:10:08.475221 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.475192 2573 generic.go:358] "Generic (PLEG): container finished" podID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerID="1fdf7284022c379f1d75125d031f756ada722d9ed5295c82526a219ecdc19f73" exitCode=0 May 28 16:10:08.475351 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.475273 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" event={"ID":"08b1286a-0ac0-4dc6-8158-f692ea9cd432","Type":"ContainerDied","Data":"1fdf7284022c379f1d75125d031f756ada722d9ed5295c82526a219ecdc19f73"} May 28 16:10:08.475351 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.475316 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" event={"ID":"08b1286a-0ac0-4dc6-8158-f692ea9cd432","Type":"ContainerStarted","Data":"f281be387fdf9d4a33f873a0c8b5f9ac3c9e294cc0236c2fe9bd072657b3fb88"} May 28 16:10:08.476947 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.476925 2573 generic.go:358] "Generic (PLEG): container finished" podID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerID="e6d3bdfb8a7403241df147e804087897905a11943d891dc7e5d3ba4b719ace48" exitCode=0 May 28 16:10:08.477044 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.477022 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" event={"ID":"685c55be-fd3f-4ecc-83f7-9cb46a6d94de","Type":"ContainerDied","Data":"e6d3bdfb8a7403241df147e804087897905a11943d891dc7e5d3ba4b719ace48"} May 28 16:10:08.478840 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.478819 2573 generic.go:358] "Generic (PLEG): container finished" podID="aec2f588-890c-44f9-8056-aa42af7c072a" containerID="ecd4dc7506fa8720ab214b957d78e0d470b371d177b2737e81afbe4d049321a8" exitCode=0 May 28 16:10:08.478920 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.478905 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" event={"ID":"aec2f588-890c-44f9-8056-aa42af7c072a","Type":"ContainerDied","Data":"ecd4dc7506fa8720ab214b957d78e0d470b371d177b2737e81afbe4d049321a8"} May 28 16:10:08.480393 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:08.480364 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" event={"ID":"cbf10869-10cf-4cb1-8ebd-b8246665b64e","Type":"ContainerStarted","Data":"a4dde697312ff787c8f590d019873a3d6df2c8fb630b974c864d279228ffead4"} May 28 16:10:09.485608 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.485572 2573 generic.go:358] "Generic (PLEG): container finished" podID="aec2f588-890c-44f9-8056-aa42af7c072a" containerID="f3572cefac8c01ee072ce1f29bd6164ff97ce5c7ba54041279975ff92a1d6070" exitCode=0 May 28 16:10:09.486057 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.485659 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" event={"ID":"aec2f588-890c-44f9-8056-aa42af7c072a","Type":"ContainerDied","Data":"f3572cefac8c01ee072ce1f29bd6164ff97ce5c7ba54041279975ff92a1d6070"} May 28 16:10:09.486985 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.486965 2573 generic.go:358] "Generic (PLEG): container finished" podID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerID="151fce968701f23928fb79a6880e89917fa3b95afb330a3892c07c3828d47541" exitCode=0 May 28 16:10:09.487082 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.487036 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" event={"ID":"cbf10869-10cf-4cb1-8ebd-b8246665b64e","Type":"ContainerDied","Data":"151fce968701f23928fb79a6880e89917fa3b95afb330a3892c07c3828d47541"} May 28 16:10:09.488670 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.488650 2573 generic.go:358] "Generic (PLEG): container finished" podID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerID="4f71d8441ef85cce69b3504ef0316d9e57d8e2bc219fd39fc4482f6b3e3f57a2" exitCode=0 May 28 16:10:09.488741 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.488704 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" event={"ID":"08b1286a-0ac0-4dc6-8158-f692ea9cd432","Type":"ContainerDied","Data":"4f71d8441ef85cce69b3504ef0316d9e57d8e2bc219fd39fc4482f6b3e3f57a2"} May 28 16:10:09.490781 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.490754 2573 generic.go:358] "Generic (PLEG): container finished" podID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerID="9e45e6feea9be6250cbe5bcb0ed24327e61cfbfaaf7cc6b68753127bf113cd41" exitCode=0 May 28 16:10:09.490867 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:09.490778 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" event={"ID":"685c55be-fd3f-4ecc-83f7-9cb46a6d94de","Type":"ContainerDied","Data":"9e45e6feea9be6250cbe5bcb0ed24327e61cfbfaaf7cc6b68753127bf113cd41"} May 28 16:10:10.495897 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.495860 2573 generic.go:358] "Generic (PLEG): container finished" podID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerID="791e79a844057a57c7de2b0dfa8fd8b0b6784edbaac7fd031535c83a0c51ef2d" exitCode=0 May 28 16:10:10.496422 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.495951 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" event={"ID":"cbf10869-10cf-4cb1-8ebd-b8246665b64e","Type":"ContainerDied","Data":"791e79a844057a57c7de2b0dfa8fd8b0b6784edbaac7fd031535c83a0c51ef2d"} May 28 16:10:10.497854 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.497832 2573 generic.go:358] "Generic (PLEG): container finished" podID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerID="60005ae7d4ef26948cc552e9a49a3137ba975b1732f6862102229cb6b40e3298" exitCode=0 May 28 16:10:10.497925 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.497906 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" event={"ID":"08b1286a-0ac0-4dc6-8158-f692ea9cd432","Type":"ContainerDied","Data":"60005ae7d4ef26948cc552e9a49a3137ba975b1732f6862102229cb6b40e3298"} May 28 16:10:10.634474 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.634447 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:10.703953 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.703930 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:10.705126 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.705090 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-util\") pod \"aec2f588-890c-44f9-8056-aa42af7c072a\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " May 28 16:10:10.705264 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.705163 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-bundle\") pod \"aec2f588-890c-44f9-8056-aa42af7c072a\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " May 28 16:10:10.705264 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.705182 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5cw6\" (UniqueName: \"kubernetes.io/projected/aec2f588-890c-44f9-8056-aa42af7c072a-kube-api-access-j5cw6\") pod \"aec2f588-890c-44f9-8056-aa42af7c072a\" (UID: \"aec2f588-890c-44f9-8056-aa42af7c072a\") " May 28 16:10:10.705683 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.705656 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-bundle" (OuterVolumeSpecName: "bundle") pod "aec2f588-890c-44f9-8056-aa42af7c072a" (UID: "aec2f588-890c-44f9-8056-aa42af7c072a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:10.707455 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.707427 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec2f588-890c-44f9-8056-aa42af7c072a-kube-api-access-j5cw6" (OuterVolumeSpecName: "kube-api-access-j5cw6") pod "aec2f588-890c-44f9-8056-aa42af7c072a" (UID: "aec2f588-890c-44f9-8056-aa42af7c072a"). InnerVolumeSpecName "kube-api-access-j5cw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:10.710038 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.710005 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-util" (OuterVolumeSpecName: "util") pod "aec2f588-890c-44f9-8056-aa42af7c072a" (UID: "aec2f588-890c-44f9-8056-aa42af7c072a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:10.805523 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805492 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-bundle\") pod \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " May 28 16:10:10.805673 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805557 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-util\") pod \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " May 28 16:10:10.805673 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805588 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5mhw\" (UniqueName: \"kubernetes.io/projected/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-kube-api-access-s5mhw\") pod \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\" (UID: \"685c55be-fd3f-4ecc-83f7-9cb46a6d94de\") " May 28 16:10:10.805761 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805728 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:10.805761 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805747 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5cw6\" (UniqueName: \"kubernetes.io/projected/aec2f588-890c-44f9-8056-aa42af7c072a-kube-api-access-j5cw6\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:10.805824 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805761 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec2f588-890c-44f9-8056-aa42af7c072a-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:10.805991 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.805965 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-bundle" (OuterVolumeSpecName: "bundle") pod "685c55be-fd3f-4ecc-83f7-9cb46a6d94de" (UID: "685c55be-fd3f-4ecc-83f7-9cb46a6d94de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:10.807689 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.807666 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-kube-api-access-s5mhw" (OuterVolumeSpecName: "kube-api-access-s5mhw") pod "685c55be-fd3f-4ecc-83f7-9cb46a6d94de" (UID: "685c55be-fd3f-4ecc-83f7-9cb46a6d94de"). InnerVolumeSpecName "kube-api-access-s5mhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:10.810713 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.810677 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-util" (OuterVolumeSpecName: "util") pod "685c55be-fd3f-4ecc-83f7-9cb46a6d94de" (UID: "685c55be-fd3f-4ecc-83f7-9cb46a6d94de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:10.906371 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.906270 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:10.906371 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.906307 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5mhw\" (UniqueName: \"kubernetes.io/projected/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-kube-api-access-s5mhw\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:10.906371 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:10.906322 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685c55be-fd3f-4ecc-83f7-9cb46a6d94de-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:11.503610 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.503581 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" May 28 16:10:11.503990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.503581 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm" event={"ID":"aec2f588-890c-44f9-8056-aa42af7c072a","Type":"ContainerDied","Data":"4dd407c85bede72e864706138286f825c430aff7c0de38f84645c4265b6c70eb"} May 28 16:10:11.503990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.503690 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dd407c85bede72e864706138286f825c430aff7c0de38f84645c4265b6c70eb" May 28 16:10:11.505342 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.505309 2573 generic.go:358] "Generic (PLEG): container finished" podID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerID="a3f5ac4ea6ed923db8457587ba7e1d50fee216d0488b68398c251a948e41c9b9" exitCode=0 May 28 16:10:11.505471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.505393 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" event={"ID":"cbf10869-10cf-4cb1-8ebd-b8246665b64e","Type":"ContainerDied","Data":"a3f5ac4ea6ed923db8457587ba7e1d50fee216d0488b68398c251a948e41c9b9"} May 28 16:10:11.507041 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.507020 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" May 28 16:10:11.507190 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.507045 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh" event={"ID":"685c55be-fd3f-4ecc-83f7-9cb46a6d94de","Type":"ContainerDied","Data":"ffd9ad01431b998b79479d1a1278bd5161680ac13ec3d0f6f2d9f94feb334843"} May 28 16:10:11.507190 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.507068 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd9ad01431b998b79479d1a1278bd5161680ac13ec3d0f6f2d9f94feb334843" May 28 16:10:11.633147 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.633125 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:11.711483 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.711446 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-bundle\") pod \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " May 28 16:10:11.711655 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.711512 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-util\") pod \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " May 28 16:10:11.711655 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.711543 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg6mj\" (UniqueName: \"kubernetes.io/projected/08b1286a-0ac0-4dc6-8158-f692ea9cd432-kube-api-access-vg6mj\") pod \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\" (UID: \"08b1286a-0ac0-4dc6-8158-f692ea9cd432\") " May 28 16:10:11.712235 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.712198 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-bundle" (OuterVolumeSpecName: "bundle") pod "08b1286a-0ac0-4dc6-8158-f692ea9cd432" (UID: "08b1286a-0ac0-4dc6-8158-f692ea9cd432"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:11.713641 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.713621 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b1286a-0ac0-4dc6-8158-f692ea9cd432-kube-api-access-vg6mj" (OuterVolumeSpecName: "kube-api-access-vg6mj") pod "08b1286a-0ac0-4dc6-8158-f692ea9cd432" (UID: "08b1286a-0ac0-4dc6-8158-f692ea9cd432"). InnerVolumeSpecName "kube-api-access-vg6mj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:11.719534 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.719504 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-util" (OuterVolumeSpecName: "util") pod "08b1286a-0ac0-4dc6-8158-f692ea9cd432" (UID: "08b1286a-0ac0-4dc6-8158-f692ea9cd432"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:11.812631 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.812593 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg6mj\" (UniqueName: \"kubernetes.io/projected/08b1286a-0ac0-4dc6-8158-f692ea9cd432-kube-api-access-vg6mj\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:11.812631 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.812626 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:11.812631 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:11.812636 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08b1286a-0ac0-4dc6-8158-f692ea9cd432-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:12.512519 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.512477 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" event={"ID":"08b1286a-0ac0-4dc6-8158-f692ea9cd432","Type":"ContainerDied","Data":"f281be387fdf9d4a33f873a0c8b5f9ac3c9e294cc0236c2fe9bd072657b3fb88"} May 28 16:10:12.512519 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.512498 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp" May 28 16:10:12.512519 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.512513 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f281be387fdf9d4a33f873a0c8b5f9ac3c9e294cc0236c2fe9bd072657b3fb88" May 28 16:10:12.639609 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.639583 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:10:12.719750 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.719713 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-util\") pod \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " May 28 16:10:12.719913 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.719770 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzzdc\" (UniqueName: \"kubernetes.io/projected/cbf10869-10cf-4cb1-8ebd-b8246665b64e-kube-api-access-qzzdc\") pod \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " May 28 16:10:12.719913 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.719799 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-bundle\") pod \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\" (UID: \"cbf10869-10cf-4cb1-8ebd-b8246665b64e\") " May 28 16:10:12.720336 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.720314 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-bundle" (OuterVolumeSpecName: "bundle") pod "cbf10869-10cf-4cb1-8ebd-b8246665b64e" (UID: "cbf10869-10cf-4cb1-8ebd-b8246665b64e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:12.721919 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.721888 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf10869-10cf-4cb1-8ebd-b8246665b64e-kube-api-access-qzzdc" (OuterVolumeSpecName: "kube-api-access-qzzdc") pod "cbf10869-10cf-4cb1-8ebd-b8246665b64e" (UID: "cbf10869-10cf-4cb1-8ebd-b8246665b64e"). InnerVolumeSpecName "kube-api-access-qzzdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:10:12.725195 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.725173 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-util" (OuterVolumeSpecName: "util") pod "cbf10869-10cf-4cb1-8ebd-b8246665b64e" (UID: "cbf10869-10cf-4cb1-8ebd-b8246665b64e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 16:10:12.820579 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.820468 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzzdc\" (UniqueName: \"kubernetes.io/projected/cbf10869-10cf-4cb1-8ebd-b8246665b64e-kube-api-access-qzzdc\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:12.820579 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.820516 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-bundle\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:12.820579 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:12.820526 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbf10869-10cf-4cb1-8ebd-b8246665b64e-util\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:10:13.518445 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:13.518411 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" event={"ID":"cbf10869-10cf-4cb1-8ebd-b8246665b64e","Type":"ContainerDied","Data":"a4dde697312ff787c8f590d019873a3d6df2c8fb630b974c864d279228ffead4"} May 28 16:10:13.518445 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:13.518445 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4dde697312ff787c8f590d019873a3d6df2c8fb630b974c864d279228ffead4" May 28 16:10:13.518445 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:10:13.518427 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn" May 28 16:11:36.985327 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985288 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985541 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985551 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985559 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985564 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985571 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985578 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985589 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985594 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985601 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985606 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985611 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985616 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985622 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985627 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985636 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985641 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985647 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985652 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="util" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985658 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985663 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985670 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985674 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985681 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985686 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="pull" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985725 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="685c55be-fd3f-4ecc-83f7-9cb46a6d94de" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985733 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="08b1286a-0ac0-4dc6-8158-f692ea9cd432" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985739 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbf10869-10cf-4cb1-8ebd-b8246665b64e" containerName="extract" May 28 16:11:36.985787 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.985746 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="aec2f588-890c-44f9-8056-aa42af7c072a" containerName="extract" May 28 16:11:36.988435 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.988417 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:36.991231 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.991209 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 16:11:36.991358 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.991280 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 16:11:36.991358 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.991283 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 16:11:36.992196 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.992179 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-57gqv\"" May 28 16:11:36.997745 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:36.997719 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:37.086111 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.086058 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:37.086265 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.086187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bfcc9c12-9c91-4144-90fd-61a4381fd47a-config-file\") pod \"limitador-limitador-7d549b5b-hvz8s\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.086265 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.086243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hk9\" (UniqueName: \"kubernetes.io/projected/bfcc9c12-9c91-4144-90fd-61a4381fd47a-kube-api-access-22hk9\") pod \"limitador-limitador-7d549b5b-hvz8s\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.187029 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.186985 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22hk9\" (UniqueName: \"kubernetes.io/projected/bfcc9c12-9c91-4144-90fd-61a4381fd47a-kube-api-access-22hk9\") pod \"limitador-limitador-7d549b5b-hvz8s\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.187249 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.187062 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bfcc9c12-9c91-4144-90fd-61a4381fd47a-config-file\") pod \"limitador-limitador-7d549b5b-hvz8s\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.187704 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.187683 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bfcc9c12-9c91-4144-90fd-61a4381fd47a-config-file\") pod \"limitador-limitador-7d549b5b-hvz8s\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.196249 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.196221 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hk9\" (UniqueName: \"kubernetes.io/projected/bfcc9c12-9c91-4144-90fd-61a4381fd47a-kube-api-access-22hk9\") pod \"limitador-limitador-7d549b5b-hvz8s\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.299617 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.299524 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:37.426561 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.426515 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:37.432840 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:11:37.432814 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcc9c12_9c91_4144_90fd_61a4381fd47a.slice/crio-cd27ed7e8bee6e4630998c2ea8be649f6e91da3919d6e7ff400b28d777a01656 WatchSource:0}: Error finding container cd27ed7e8bee6e4630998c2ea8be649f6e91da3919d6e7ff400b28d777a01656: Status 404 returned error can't find the container with id cd27ed7e8bee6e4630998c2ea8be649f6e91da3919d6e7ff400b28d777a01656 May 28 16:11:37.811837 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:37.811790 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" event={"ID":"bfcc9c12-9c91-4144-90fd-61a4381fd47a","Type":"ContainerStarted","Data":"cd27ed7e8bee6e4630998c2ea8be649f6e91da3919d6e7ff400b28d777a01656"} May 28 16:11:40.825850 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:40.825812 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" event={"ID":"bfcc9c12-9c91-4144-90fd-61a4381fd47a","Type":"ContainerStarted","Data":"fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43"} May 28 16:11:40.826329 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:40.825893 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:40.845202 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:40.845142 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" podStartSLOduration=1.908949737 podStartE2EDuration="4.845127248s" podCreationTimestamp="2026-05-28 16:11:36 +0000 UTC" firstStartedPulling="2026-05-28 16:11:37.435161891 +0000 UTC m=+515.917684762" lastFinishedPulling="2026-05-28 16:11:40.3713394 +0000 UTC m=+518.853862273" observedRunningTime="2026-05-28 16:11:40.842610176 +0000 UTC m=+519.325133068" watchObservedRunningTime="2026-05-28 16:11:40.845127248 +0000 UTC m=+519.327650135" May 28 16:11:51.831075 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:51.830994 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:53.862642 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:53.862605 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:53.863046 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:53.862829 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" podUID="bfcc9c12-9c91-4144-90fd-61a4381fd47a" containerName="limitador" containerID="cri-o://fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43" gracePeriod=30 May 28 16:11:54.403460 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.403437 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:54.536116 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.536060 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bfcc9c12-9c91-4144-90fd-61a4381fd47a-config-file\") pod \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " May 28 16:11:54.536315 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.536140 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22hk9\" (UniqueName: \"kubernetes.io/projected/bfcc9c12-9c91-4144-90fd-61a4381fd47a-kube-api-access-22hk9\") pod \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\" (UID: \"bfcc9c12-9c91-4144-90fd-61a4381fd47a\") " May 28 16:11:54.536428 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.536404 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfcc9c12-9c91-4144-90fd-61a4381fd47a-config-file" (OuterVolumeSpecName: "config-file") pod "bfcc9c12-9c91-4144-90fd-61a4381fd47a" (UID: "bfcc9c12-9c91-4144-90fd-61a4381fd47a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 16:11:54.538178 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.538158 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfcc9c12-9c91-4144-90fd-61a4381fd47a-kube-api-access-22hk9" (OuterVolumeSpecName: "kube-api-access-22hk9") pod "bfcc9c12-9c91-4144-90fd-61a4381fd47a" (UID: "bfcc9c12-9c91-4144-90fd-61a4381fd47a"). InnerVolumeSpecName "kube-api-access-22hk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:11:54.637135 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.637079 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22hk9\" (UniqueName: \"kubernetes.io/projected/bfcc9c12-9c91-4144-90fd-61a4381fd47a-kube-api-access-22hk9\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:11:54.637135 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.637130 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bfcc9c12-9c91-4144-90fd-61a4381fd47a-config-file\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:11:54.879566 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.879469 2573 generic.go:358] "Generic (PLEG): container finished" podID="bfcc9c12-9c91-4144-90fd-61a4381fd47a" containerID="fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43" exitCode=0 May 28 16:11:54.879566 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.879542 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" May 28 16:11:54.879566 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.879558 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" event={"ID":"bfcc9c12-9c91-4144-90fd-61a4381fd47a","Type":"ContainerDied","Data":"fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43"} May 28 16:11:54.880151 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.879592 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-hvz8s" event={"ID":"bfcc9c12-9c91-4144-90fd-61a4381fd47a","Type":"ContainerDied","Data":"cd27ed7e8bee6e4630998c2ea8be649f6e91da3919d6e7ff400b28d777a01656"} May 28 16:11:54.880151 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.879613 2573 scope.go:117] "RemoveContainer" containerID="fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43" May 28 16:11:54.888127 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.888088 2573 scope.go:117] "RemoveContainer" containerID="fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43" May 28 16:11:54.888392 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:11:54.888371 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43\": container with ID starting with fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43 not found: ID does not exist" containerID="fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43" May 28 16:11:54.888471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.888400 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43"} err="failed to get container status \"fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43\": rpc error: code = NotFound desc = could not find container \"fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43\": container with ID starting with fe3923c7b2847e97e0527b57ebb5bbebfab7ec87582ead334bc896373c584a43 not found: ID does not exist" May 28 16:11:54.900461 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.900424 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:54.902878 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:54.902852 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-hvz8s"] May 28 16:11:56.085981 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:56.085947 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfcc9c12-9c91-4144-90fd-61a4381fd47a" path="/var/lib/kubelet/pods/bfcc9c12-9c91-4144-90fd-61a4381fd47a/volumes" May 28 16:11:57.546440 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.546402 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-sswrm"] May 28 16:11:57.546816 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.546650 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfcc9c12-9c91-4144-90fd-61a4381fd47a" containerName="limitador" May 28 16:11:57.546816 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.546660 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfcc9c12-9c91-4144-90fd-61a4381fd47a" containerName="limitador" May 28 16:11:57.546816 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.546719 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="bfcc9c12-9c91-4144-90fd-61a4381fd47a" containerName="limitador" May 28 16:11:57.550721 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.550695 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.556510 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.556486 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7sm6z\"" May 28 16:11:57.556888 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.556868 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 28 16:11:57.576072 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.576041 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-sswrm"] May 28 16:11:57.663164 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.663121 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e1727035-3479-4e93-b6bb-10e247e5efe9-data\") pod \"postgres-68c4fbbd6f-sswrm\" (UID: \"e1727035-3479-4e93-b6bb-10e247e5efe9\") " pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.663288 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.663254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6q4\" (UniqueName: \"kubernetes.io/projected/e1727035-3479-4e93-b6bb-10e247e5efe9-kube-api-access-zh6q4\") pod \"postgres-68c4fbbd6f-sswrm\" (UID: \"e1727035-3479-4e93-b6bb-10e247e5efe9\") " pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.764172 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.764128 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6q4\" (UniqueName: \"kubernetes.io/projected/e1727035-3479-4e93-b6bb-10e247e5efe9-kube-api-access-zh6q4\") pod \"postgres-68c4fbbd6f-sswrm\" (UID: \"e1727035-3479-4e93-b6bb-10e247e5efe9\") " pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.764356 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.764189 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e1727035-3479-4e93-b6bb-10e247e5efe9-data\") pod \"postgres-68c4fbbd6f-sswrm\" (UID: \"e1727035-3479-4e93-b6bb-10e247e5efe9\") " pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.764537 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.764520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e1727035-3479-4e93-b6bb-10e247e5efe9-data\") pod \"postgres-68c4fbbd6f-sswrm\" (UID: \"e1727035-3479-4e93-b6bb-10e247e5efe9\") " pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.773778 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.773741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6q4\" (UniqueName: \"kubernetes.io/projected/e1727035-3479-4e93-b6bb-10e247e5efe9-kube-api-access-zh6q4\") pod \"postgres-68c4fbbd6f-sswrm\" (UID: \"e1727035-3479-4e93-b6bb-10e247e5efe9\") " pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.864052 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.863980 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:11:57.993890 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:57.993856 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-sswrm"] May 28 16:11:57.996869 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:11:57.996834 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1727035_3479_4e93_b6bb_10e247e5efe9.slice/crio-62ccedaa35345c9e865daaa893a60db0ec2e7fae4adc0459551712b910b89491 WatchSource:0}: Error finding container 62ccedaa35345c9e865daaa893a60db0ec2e7fae4adc0459551712b910b89491: Status 404 returned error can't find the container with id 62ccedaa35345c9e865daaa893a60db0ec2e7fae4adc0459551712b910b89491 May 28 16:11:58.898078 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:11:58.898041 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-sswrm" event={"ID":"e1727035-3479-4e93-b6bb-10e247e5efe9","Type":"ContainerStarted","Data":"62ccedaa35345c9e865daaa893a60db0ec2e7fae4adc0459551712b910b89491"} May 28 16:12:02.922586 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:02.922561 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 28 16:12:03.922088 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:03.922052 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-sswrm" event={"ID":"e1727035-3479-4e93-b6bb-10e247e5efe9","Type":"ContainerStarted","Data":"705d6c2a0da32c96afe7244e9e2ca31029dd2ca99e1f39e70a849c4711d07c6c"} May 28 16:12:03.938471 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:03.938421 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-sswrm" podStartSLOduration=2.017038918 podStartE2EDuration="6.938405916s" podCreationTimestamp="2026-05-28 16:11:57 +0000 UTC" firstStartedPulling="2026-05-28 16:11:57.998187851 +0000 UTC m=+536.480710733" lastFinishedPulling="2026-05-28 16:12:02.919554858 +0000 UTC m=+541.402077731" observedRunningTime="2026-05-28 16:12:03.937045201 +0000 UTC m=+542.419568104" watchObservedRunningTime="2026-05-28 16:12:03.938405916 +0000 UTC m=+542.420928804" May 28 16:12:04.925472 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:04.925433 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:12:10.956611 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:10.956581 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-sswrm" May 28 16:12:11.779829 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.779788 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5954c4fd9-cbp97"] May 28 16:12:11.783323 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.783297 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:11.786008 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.785984 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 16:12:11.786137 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.786057 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p8wpm\"" May 28 16:12:11.787246 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.787188 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 16:12:11.789615 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.789593 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5954c4fd9-cbp97"] May 28 16:12:11.879283 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.879240 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9dn\" (UniqueName: \"kubernetes.io/projected/7d3d0899-2059-4f5f-873c-a88194ceb525-kube-api-access-fz9dn\") pod \"authorino-5954c4fd9-cbp97\" (UID: \"7d3d0899-2059-4f5f-873c-a88194ceb525\") " pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:11.980164 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.980119 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9dn\" (UniqueName: \"kubernetes.io/projected/7d3d0899-2059-4f5f-873c-a88194ceb525-kube-api-access-fz9dn\") pod \"authorino-5954c4fd9-cbp97\" (UID: \"7d3d0899-2059-4f5f-873c-a88194ceb525\") " pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:11.987929 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.987903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9dn\" (UniqueName: \"kubernetes.io/projected/7d3d0899-2059-4f5f-873c-a88194ceb525-kube-api-access-fz9dn\") pod \"authorino-5954c4fd9-cbp97\" (UID: \"7d3d0899-2059-4f5f-873c-a88194ceb525\") " pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:11.999150 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.999118 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5954c4fd9-cbp97"] May 28 16:12:11.999357 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:11.999345 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:12.132634 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:12.132605 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5954c4fd9-cbp97"] May 28 16:12:12.135011 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:12:12.134982 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d3d0899_2059_4f5f_873c_a88194ceb525.slice/crio-a17d9f30a69b5d990fcdbccb363d15a4e19609c0df38075d2981c2d4b6bf990e WatchSource:0}: Error finding container a17d9f30a69b5d990fcdbccb363d15a4e19609c0df38075d2981c2d4b6bf990e: Status 404 returned error can't find the container with id a17d9f30a69b5d990fcdbccb363d15a4e19609c0df38075d2981c2d4b6bf990e May 28 16:12:12.954264 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:12.954226 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5954c4fd9-cbp97" event={"ID":"7d3d0899-2059-4f5f-873c-a88194ceb525","Type":"ContainerStarted","Data":"a17d9f30a69b5d990fcdbccb363d15a4e19609c0df38075d2981c2d4b6bf990e"} May 28 16:12:15.966498 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:15.966461 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5954c4fd9-cbp97" event={"ID":"7d3d0899-2059-4f5f-873c-a88194ceb525","Type":"ContainerStarted","Data":"0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948"} May 28 16:12:15.966943 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:15.966525 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5954c4fd9-cbp97" podUID="7d3d0899-2059-4f5f-873c-a88194ceb525" containerName="authorino" containerID="cri-o://0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948" gracePeriod=30 May 28 16:12:15.981809 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:15.981768 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5954c4fd9-cbp97" podStartSLOduration=2.134963209 podStartE2EDuration="4.981753563s" podCreationTimestamp="2026-05-28 16:12:11 +0000 UTC" firstStartedPulling="2026-05-28 16:12:12.136371426 +0000 UTC m=+550.618894294" lastFinishedPulling="2026-05-28 16:12:14.983161766 +0000 UTC m=+553.465684648" observedRunningTime="2026-05-28 16:12:15.980403407 +0000 UTC m=+554.462926298" watchObservedRunningTime="2026-05-28 16:12:15.981753563 +0000 UTC m=+554.464276453" May 28 16:12:16.218023 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.217957 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:16.316563 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.316529 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz9dn\" (UniqueName: \"kubernetes.io/projected/7d3d0899-2059-4f5f-873c-a88194ceb525-kube-api-access-fz9dn\") pod \"7d3d0899-2059-4f5f-873c-a88194ceb525\" (UID: \"7d3d0899-2059-4f5f-873c-a88194ceb525\") " May 28 16:12:16.318396 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.318357 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3d0899-2059-4f5f-873c-a88194ceb525-kube-api-access-fz9dn" (OuterVolumeSpecName: "kube-api-access-fz9dn") pod "7d3d0899-2059-4f5f-873c-a88194ceb525" (UID: "7d3d0899-2059-4f5f-873c-a88194ceb525"). InnerVolumeSpecName "kube-api-access-fz9dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:12:16.417210 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.417173 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz9dn\" (UniqueName: \"kubernetes.io/projected/7d3d0899-2059-4f5f-873c-a88194ceb525-kube-api-access-fz9dn\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:12:16.971018 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.970982 2573 generic.go:358] "Generic (PLEG): container finished" podID="7d3d0899-2059-4f5f-873c-a88194ceb525" containerID="0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948" exitCode=0 May 28 16:12:16.971496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.971041 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5954c4fd9-cbp97" May 28 16:12:16.971496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.971043 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5954c4fd9-cbp97" event={"ID":"7d3d0899-2059-4f5f-873c-a88194ceb525","Type":"ContainerDied","Data":"0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948"} May 28 16:12:16.971496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.971136 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5954c4fd9-cbp97" event={"ID":"7d3d0899-2059-4f5f-873c-a88194ceb525","Type":"ContainerDied","Data":"a17d9f30a69b5d990fcdbccb363d15a4e19609c0df38075d2981c2d4b6bf990e"} May 28 16:12:16.971496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.971152 2573 scope.go:117] "RemoveContainer" containerID="0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948" May 28 16:12:16.982143 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.982068 2573 scope.go:117] "RemoveContainer" containerID="0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948" May 28 16:12:16.982791 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:12:16.982765 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948\": container with ID starting with 0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948 not found: ID does not exist" containerID="0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948" May 28 16:12:16.982889 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.982802 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948"} err="failed to get container status \"0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948\": rpc error: code = NotFound desc = could not find container \"0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948\": container with ID starting with 0bf1a9ce06b3d8ddb2874a6035cf79085e9a60948abce8314032a9d2ee977948 not found: ID does not exist" May 28 16:12:16.995232 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.995197 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5954c4fd9-cbp97"] May 28 16:12:16.997875 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:16.997854 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5954c4fd9-cbp97"] May 28 16:12:18.082914 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:18.082877 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3d0899-2059-4f5f-873c-a88194ceb525" path="/var/lib/kubelet/pods/7d3d0899-2059-4f5f-873c-a88194ceb525/volumes" May 28 16:12:19.310039 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.310002 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c9d4859b-4n96s"] May 28 16:12:19.310433 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.310304 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3d0899-2059-4f5f-873c-a88194ceb525" containerName="authorino" May 28 16:12:19.310433 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.310317 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3d0899-2059-4f5f-873c-a88194ceb525" containerName="authorino" May 28 16:12:19.310433 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.310393 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d3d0899-2059-4f5f-873c-a88194ceb525" containerName="authorino" May 28 16:12:19.314396 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.314378 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:19.317246 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.317217 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9v4rs\"" May 28 16:12:19.317397 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.317378 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 28 16:12:19.322869 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.322847 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-4n96s"] May 28 16:12:19.337887 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.337852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmz8w\" (UniqueName: \"kubernetes.io/projected/32365517-6f5a-4c2b-8084-9264ff9ca27d-kube-api-access-hmz8w\") pod \"maas-controller-5c9d4859b-4n96s\" (UID: \"32365517-6f5a-4c2b-8084-9264ff9ca27d\") " pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:19.439147 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.439082 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmz8w\" (UniqueName: \"kubernetes.io/projected/32365517-6f5a-4c2b-8084-9264ff9ca27d-kube-api-access-hmz8w\") pod \"maas-controller-5c9d4859b-4n96s\" (UID: \"32365517-6f5a-4c2b-8084-9264ff9ca27d\") " pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:19.448263 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.448242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmz8w\" (UniqueName: \"kubernetes.io/projected/32365517-6f5a-4c2b-8084-9264ff9ca27d-kube-api-access-hmz8w\") pod \"maas-controller-5c9d4859b-4n96s\" (UID: \"32365517-6f5a-4c2b-8084-9264ff9ca27d\") " pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:19.488763 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.488727 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fdc447758-56kd6"] May 28 16:12:19.492218 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.492195 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:19.505228 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.505197 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc447758-56kd6"] May 28 16:12:19.539653 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.539608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzxl\" (UniqueName: \"kubernetes.io/projected/6701d582-fe41-4c6b-80cb-80ca62a32f0f-kube-api-access-qjzxl\") pod \"maas-controller-6fdc447758-56kd6\" (UID: \"6701d582-fe41-4c6b-80cb-80ca62a32f0f\") " pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:19.625308 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.625211 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:19.640293 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.640264 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzxl\" (UniqueName: \"kubernetes.io/projected/6701d582-fe41-4c6b-80cb-80ca62a32f0f-kube-api-access-qjzxl\") pod \"maas-controller-6fdc447758-56kd6\" (UID: \"6701d582-fe41-4c6b-80cb-80ca62a32f0f\") " pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:19.651476 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.651444 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzxl\" (UniqueName: \"kubernetes.io/projected/6701d582-fe41-4c6b-80cb-80ca62a32f0f-kube-api-access-qjzxl\") pod \"maas-controller-6fdc447758-56kd6\" (UID: \"6701d582-fe41-4c6b-80cb-80ca62a32f0f\") " pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:19.755810 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.755782 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-4n96s"] May 28 16:12:19.757959 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:12:19.757928 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32365517_6f5a_4c2b_8084_9264ff9ca27d.slice/crio-d93112723c2ee33162ce054b61d5bf48fd5f351c145a842df6b1bfaddf632291 WatchSource:0}: Error finding container d93112723c2ee33162ce054b61d5bf48fd5f351c145a842df6b1bfaddf632291: Status 404 returned error can't find the container with id d93112723c2ee33162ce054b61d5bf48fd5f351c145a842df6b1bfaddf632291 May 28 16:12:19.802286 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.802243 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:19.925622 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.925598 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc447758-56kd6"] May 28 16:12:19.927318 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:12:19.927293 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6701d582_fe41_4c6b_80cb_80ca62a32f0f.slice/crio-d1660d14c4f81381298a63234845d24c8732a21aa8755b65ca22f5752b2d6d95 WatchSource:0}: Error finding container d1660d14c4f81381298a63234845d24c8732a21aa8755b65ca22f5752b2d6d95: Status 404 returned error can't find the container with id d1660d14c4f81381298a63234845d24c8732a21aa8755b65ca22f5752b2d6d95 May 28 16:12:19.984163 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.984122 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc447758-56kd6" event={"ID":"6701d582-fe41-4c6b-80cb-80ca62a32f0f","Type":"ContainerStarted","Data":"d1660d14c4f81381298a63234845d24c8732a21aa8755b65ca22f5752b2d6d95"} May 28 16:12:19.985082 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:19.985058 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-4n96s" event={"ID":"32365517-6f5a-4c2b-8084-9264ff9ca27d","Type":"ContainerStarted","Data":"d93112723c2ee33162ce054b61d5bf48fd5f351c145a842df6b1bfaddf632291"} May 28 16:12:23.000391 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:23.000347 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc447758-56kd6" event={"ID":"6701d582-fe41-4c6b-80cb-80ca62a32f0f","Type":"ContainerStarted","Data":"a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93"} May 28 16:12:23.000880 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:23.000539 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:23.001872 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:23.001842 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-4n96s" event={"ID":"32365517-6f5a-4c2b-8084-9264ff9ca27d","Type":"ContainerStarted","Data":"87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5"} May 28 16:12:23.002011 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:23.002001 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:23.023840 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:23.023776 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6fdc447758-56kd6" podStartSLOduration=1.53766866 podStartE2EDuration="4.023758852s" podCreationTimestamp="2026-05-28 16:12:19 +0000 UTC" firstStartedPulling="2026-05-28 16:12:19.92872724 +0000 UTC m=+558.411250108" lastFinishedPulling="2026-05-28 16:12:22.414817419 +0000 UTC m=+560.897340300" observedRunningTime="2026-05-28 16:12:23.023347013 +0000 UTC m=+561.505869914" watchObservedRunningTime="2026-05-28 16:12:23.023758852 +0000 UTC m=+561.506281746" May 28 16:12:23.045394 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:23.045338 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c9d4859b-4n96s" podStartSLOduration=1.380619232 podStartE2EDuration="4.045322204s" podCreationTimestamp="2026-05-28 16:12:19 +0000 UTC" firstStartedPulling="2026-05-28 16:12:19.759457676 +0000 UTC m=+558.241980547" lastFinishedPulling="2026-05-28 16:12:22.424160648 +0000 UTC m=+560.906683519" observedRunningTime="2026-05-28 16:12:23.044575241 +0000 UTC m=+561.527098131" watchObservedRunningTime="2026-05-28 16:12:23.045322204 +0000 UTC m=+561.527845095" May 28 16:12:34.011768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.011729 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:34.012389 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.011838 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:12:34.072434 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.072396 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-4n96s"] May 28 16:12:34.072671 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.072643 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c9d4859b-4n96s" podUID="32365517-6f5a-4c2b-8084-9264ff9ca27d" containerName="manager" containerID="cri-o://87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5" gracePeriod=30 May 28 16:12:34.321192 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.321168 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:34.342526 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.342494 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmz8w\" (UniqueName: \"kubernetes.io/projected/32365517-6f5a-4c2b-8084-9264ff9ca27d-kube-api-access-hmz8w\") pod \"32365517-6f5a-4c2b-8084-9264ff9ca27d\" (UID: \"32365517-6f5a-4c2b-8084-9264ff9ca27d\") " May 28 16:12:34.345348 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.345314 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32365517-6f5a-4c2b-8084-9264ff9ca27d-kube-api-access-hmz8w" (OuterVolumeSpecName: "kube-api-access-hmz8w") pod "32365517-6f5a-4c2b-8084-9264ff9ca27d" (UID: "32365517-6f5a-4c2b-8084-9264ff9ca27d"). InnerVolumeSpecName "kube-api-access-hmz8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:12:34.443140 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:34.443027 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmz8w\" (UniqueName: \"kubernetes.io/projected/32365517-6f5a-4c2b-8084-9264ff9ca27d-kube-api-access-hmz8w\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:12:35.046625 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.046589 2573 generic.go:358] "Generic (PLEG): container finished" podID="32365517-6f5a-4c2b-8084-9264ff9ca27d" containerID="87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5" exitCode=0 May 28 16:12:35.047077 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.046662 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-4n96s" May 28 16:12:35.047077 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.046677 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-4n96s" event={"ID":"32365517-6f5a-4c2b-8084-9264ff9ca27d","Type":"ContainerDied","Data":"87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5"} May 28 16:12:35.047077 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.046715 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-4n96s" event={"ID":"32365517-6f5a-4c2b-8084-9264ff9ca27d","Type":"ContainerDied","Data":"d93112723c2ee33162ce054b61d5bf48fd5f351c145a842df6b1bfaddf632291"} May 28 16:12:35.047077 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.046738 2573 scope.go:117] "RemoveContainer" containerID="87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5" May 28 16:12:35.055015 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.054994 2573 scope.go:117] "RemoveContainer" containerID="87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5" May 28 16:12:35.055303 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:12:35.055284 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5\": container with ID starting with 87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5 not found: ID does not exist" containerID="87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5" May 28 16:12:35.055373 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.055314 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5"} err="failed to get container status \"87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5\": rpc error: code = NotFound desc = could not find container \"87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5\": container with ID starting with 87904b57ab35d73a47e91aeada3bfec1143b5b7a320e47148af874355e7862e5 not found: ID does not exist" May 28 16:12:35.067658 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.067634 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-4n96s"] May 28 16:12:35.071138 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:35.071115 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-4n96s"] May 28 16:12:36.083138 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:36.083080 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32365517-6f5a-4c2b-8084-9264ff9ca27d" path="/var/lib/kubelet/pods/32365517-6f5a-4c2b-8084-9264ff9ca27d/volumes" May 28 16:12:53.714024 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.713980 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-64cb5dc64b-pd4zv"] May 28 16:12:53.714551 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.714295 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32365517-6f5a-4c2b-8084-9264ff9ca27d" containerName="manager" May 28 16:12:53.714551 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.714309 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32365517-6f5a-4c2b-8084-9264ff9ca27d" containerName="manager" May 28 16:12:53.714551 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.714376 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="32365517-6f5a-4c2b-8084-9264ff9ca27d" containerName="manager" May 28 16:12:53.724212 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.724188 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:53.727243 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.727213 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lb79w\"" May 28 16:12:53.727456 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.727432 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 28 16:12:53.729633 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.729608 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64cb5dc64b-pd4zv"] May 28 16:12:53.777136 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.777069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jnb\" (UniqueName: \"kubernetes.io/projected/76395b1f-6945-4fda-b05c-8d12e13f5e2d-kube-api-access-t8jnb\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:53.777312 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.777143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76395b1f-6945-4fda-b05c-8d12e13f5e2d-maas-api-tls\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:53.878015 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.877971 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jnb\" (UniqueName: \"kubernetes.io/projected/76395b1f-6945-4fda-b05c-8d12e13f5e2d-kube-api-access-t8jnb\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:53.878015 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.878017 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76395b1f-6945-4fda-b05c-8d12e13f5e2d-maas-api-tls\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:53.878276 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:12:53.878135 2573 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 28 16:12:53.878276 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:12:53.878188 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76395b1f-6945-4fda-b05c-8d12e13f5e2d-maas-api-tls podName:76395b1f-6945-4fda-b05c-8d12e13f5e2d nodeName:}" failed. No retries permitted until 2026-05-28 16:12:54.378171453 +0000 UTC m=+592.860694321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76395b1f-6945-4fda-b05c-8d12e13f5e2d-maas-api-tls") pod "maas-api-64cb5dc64b-pd4zv" (UID: "76395b1f-6945-4fda-b05c-8d12e13f5e2d") : secret "maas-api-serving-cert" not found May 28 16:12:53.886456 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:53.886422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jnb\" (UniqueName: \"kubernetes.io/projected/76395b1f-6945-4fda-b05c-8d12e13f5e2d-kube-api-access-t8jnb\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:54.142986 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.142947 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-gq7gj"] May 28 16:12:54.162201 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.162168 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-gq7gj"] May 28 16:12:54.162345 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.162295 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:12:54.164820 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.164796 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 28 16:12:54.164820 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.164816 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j7gwj\"" May 28 16:12:54.180111 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.180071 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfln\" (UniqueName: \"kubernetes.io/projected/0bd2176a-2822-4159-8d65-9367bdfeca3d-kube-api-access-8xfln\") pod \"payload-processing-58b6c8fdc7-gq7gj\" (UID: \"0bd2176a-2822-4159-8d65-9367bdfeca3d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:12:54.280629 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.280573 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfln\" (UniqueName: \"kubernetes.io/projected/0bd2176a-2822-4159-8d65-9367bdfeca3d-kube-api-access-8xfln\") pod \"payload-processing-58b6c8fdc7-gq7gj\" (UID: \"0bd2176a-2822-4159-8d65-9367bdfeca3d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:12:54.295912 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.295880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfln\" (UniqueName: \"kubernetes.io/projected/0bd2176a-2822-4159-8d65-9367bdfeca3d-kube-api-access-8xfln\") pod \"payload-processing-58b6c8fdc7-gq7gj\" (UID: \"0bd2176a-2822-4159-8d65-9367bdfeca3d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:12:54.381991 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.381960 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76395b1f-6945-4fda-b05c-8d12e13f5e2d-maas-api-tls\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:54.384665 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.384634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76395b1f-6945-4fda-b05c-8d12e13f5e2d-maas-api-tls\") pod \"maas-api-64cb5dc64b-pd4zv\" (UID: \"76395b1f-6945-4fda-b05c-8d12e13f5e2d\") " pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:54.472405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.472314 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:12:54.607323 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.607294 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-gq7gj"] May 28 16:12:54.636822 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.636800 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:54.763448 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:54.763419 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64cb5dc64b-pd4zv"] May 28 16:12:54.765009 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:12:54.764983 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76395b1f_6945_4fda_b05c_8d12e13f5e2d.slice/crio-805bb00791f6cd4edba76f22e6a82e54db388fde48f72fd3679aef4e3fecb814 WatchSource:0}: Error finding container 805bb00791f6cd4edba76f22e6a82e54db388fde48f72fd3679aef4e3fecb814: Status 404 returned error can't find the container with id 805bb00791f6cd4edba76f22e6a82e54db388fde48f72fd3679aef4e3fecb814 May 28 16:12:55.119977 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:55.119878 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" event={"ID":"0bd2176a-2822-4159-8d65-9367bdfeca3d","Type":"ContainerStarted","Data":"fca5795c41bfffe0c589c6d769db1dcebe8f4ba42ffb8170a969a7cf20b7a891"} May 28 16:12:55.120912 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:55.120886 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" event={"ID":"76395b1f-6945-4fda-b05c-8d12e13f5e2d","Type":"ContainerStarted","Data":"805bb00791f6cd4edba76f22e6a82e54db388fde48f72fd3679aef4e3fecb814"} May 28 16:12:57.129867 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:57.129770 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" event={"ID":"0bd2176a-2822-4159-8d65-9367bdfeca3d","Type":"ContainerStarted","Data":"8aebf8f25a2f1a70c545ddfe052ade2ff06545aec0fe152c392e648e8750e687"} May 28 16:12:57.130317 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:57.129882 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:12:57.131241 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:57.131215 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" event={"ID":"76395b1f-6945-4fda-b05c-8d12e13f5e2d","Type":"ContainerStarted","Data":"9467604bead74f3e882054c5e54bb9fa40e8c5537bc6a02283843a57eb763406"} May 28 16:12:57.131337 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:57.131257 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:12:57.148873 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:57.148817 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" podStartSLOduration=1.483023951 podStartE2EDuration="3.148801223s" podCreationTimestamp="2026-05-28 16:12:54 +0000 UTC" firstStartedPulling="2026-05-28 16:12:54.612195627 +0000 UTC m=+593.094718495" lastFinishedPulling="2026-05-28 16:12:56.277972896 +0000 UTC m=+594.760495767" observedRunningTime="2026-05-28 16:12:57.146333892 +0000 UTC m=+595.628856782" watchObservedRunningTime="2026-05-28 16:12:57.148801223 +0000 UTC m=+595.631324198" May 28 16:12:57.163420 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:12:57.163369 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" podStartSLOduration=2.1517578139999998 podStartE2EDuration="4.163355215s" podCreationTimestamp="2026-05-28 16:12:53 +0000 UTC" firstStartedPulling="2026-05-28 16:12:54.766346757 +0000 UTC m=+593.248869626" lastFinishedPulling="2026-05-28 16:12:56.777944155 +0000 UTC m=+595.260467027" observedRunningTime="2026-05-28 16:12:57.161526535 +0000 UTC m=+595.644049428" watchObservedRunningTime="2026-05-28 16:12:57.163355215 +0000 UTC m=+595.645878101" May 28 16:13:01.999745 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:01.999715 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:13:02.000226 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:01.999975 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:13:03.140008 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:03.139927 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-64cb5dc64b-pd4zv" May 28 16:13:08.136781 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:08.136749 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-gq7gj" May 28 16:13:17.572768 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.572730 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8"] May 28 16:13:17.575833 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.575811 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.583870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.579261 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 28 16:13:17.583870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.579582 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 28 16:13:17.583870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.579922 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-685vc\"" May 28 16:13:17.583870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.580175 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 28 16:13:17.588345 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.588316 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8"] May 28 16:13:17.687688 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.687654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.687881 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.687695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.687881 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.687715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8twtb\" (UniqueName: \"kubernetes.io/projected/8aae692f-6b84-4665-b3ee-0687ac3584c2-kube-api-access-8twtb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.687881 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.687739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.687881 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.687826 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aae692f-6b84-4665-b3ee-0687ac3584c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.687881 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.687866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.788942 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.788895 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.788951 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8twtb\" (UniqueName: \"kubernetes.io/projected/8aae692f-6b84-4665-b3ee-0687ac3584c2-kube-api-access-8twtb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.788989 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.789037 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aae692f-6b84-4665-b3ee-0687ac3584c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.789065 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789166 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.789158 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789521 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.789488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789795 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.789721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.789935 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.789820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.791570 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.791536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aae692f-6b84-4665-b3ee-0687ac3584c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.791753 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.791737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aae692f-6b84-4665-b3ee-0687ac3584c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.796867 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.796832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8twtb\" (UniqueName: \"kubernetes.io/projected/8aae692f-6b84-4665-b3ee-0687ac3584c2-kube-api-access-8twtb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8\" (UID: \"8aae692f-6b84-4665-b3ee-0687ac3584c2\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:17.891468 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:17.891384 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:18.024481 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:18.024442 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8"] May 28 16:13:18.025741 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:13:18.025709 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aae692f_6b84_4665_b3ee_0687ac3584c2.slice/crio-84f7ace99ffd853fbea2dfdc3634470489a11245974aae9421a6813302cf814d WatchSource:0}: Error finding container 84f7ace99ffd853fbea2dfdc3634470489a11245974aae9421a6813302cf814d: Status 404 returned error can't find the container with id 84f7ace99ffd853fbea2dfdc3634470489a11245974aae9421a6813302cf814d May 28 16:13:18.027669 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:18.027653 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:13:18.209607 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:18.209514 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" event={"ID":"8aae692f-6b84-4665-b3ee-0687ac3584c2","Type":"ContainerStarted","Data":"84f7ace99ffd853fbea2dfdc3634470489a11245974aae9421a6813302cf814d"} May 28 16:13:23.230785 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:23.230749 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" event={"ID":"8aae692f-6b84-4665-b3ee-0687ac3584c2","Type":"ContainerStarted","Data":"ec8117bed0243af0e000e861c085c6e4d4694c407ceb2abfaec8b41e789ab1fe"} May 28 16:13:29.260427 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:29.260389 2573 generic.go:358] "Generic (PLEG): container finished" podID="8aae692f-6b84-4665-b3ee-0687ac3584c2" containerID="ec8117bed0243af0e000e861c085c6e4d4694c407ceb2abfaec8b41e789ab1fe" exitCode=0 May 28 16:13:29.260953 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:29.260461 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" event={"ID":"8aae692f-6b84-4665-b3ee-0687ac3584c2","Type":"ContainerDied","Data":"ec8117bed0243af0e000e861c085c6e4d4694c407ceb2abfaec8b41e789ab1fe"} May 28 16:13:31.269312 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:31.269269 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" event={"ID":"8aae692f-6b84-4665-b3ee-0687ac3584c2","Type":"ContainerStarted","Data":"b87c473719057e60fd962d55946ca00d1508c124605a20c948a94e3ea42100af"} May 28 16:13:31.269800 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:31.269512 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:31.298991 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:31.298919 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" podStartSLOduration=1.5804104369999998 podStartE2EDuration="14.298899671s" podCreationTimestamp="2026-05-28 16:13:17 +0000 UTC" firstStartedPulling="2026-05-28 16:13:18.027781395 +0000 UTC m=+616.510304263" lastFinishedPulling="2026-05-28 16:13:30.746270613 +0000 UTC m=+629.228793497" observedRunningTime="2026-05-28 16:13:31.29777432 +0000 UTC m=+629.780297221" watchObservedRunningTime="2026-05-28 16:13:31.298899671 +0000 UTC m=+629.781422564" May 28 16:13:39.283347 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.283303 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm"] May 28 16:13:39.286066 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.286043 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.289052 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.289031 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 28 16:13:39.299308 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.299272 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm"] May 28 16:13:39.368799 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.368760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5137c3-7fde-4c2f-ab27-a9969732287a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.368990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.368817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.368990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.368883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgjlq\" (UniqueName: \"kubernetes.io/projected/5e5137c3-7fde-4c2f-ab27-a9969732287a-kube-api-access-mgjlq\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.368990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.368955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.368990 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.368984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.369238 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.369012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.469685 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.469638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.469876 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.469692 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.469876 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.469743 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5137c3-7fde-4c2f-ab27-a9969732287a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.469876 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.469783 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.470035 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.469908 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgjlq\" (UniqueName: \"kubernetes.io/projected/5e5137c3-7fde-4c2f-ab27-a9969732287a-kube-api-access-mgjlq\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.470035 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.469984 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.470181 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.470142 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.470256 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.470180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.470310 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.470283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.472102 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.472072 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e5137c3-7fde-4c2f-ab27-a9969732287a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.472286 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.472270 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5137c3-7fde-4c2f-ab27-a9969732287a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.478251 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.478221 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgjlq\" (UniqueName: \"kubernetes.io/projected/5e5137c3-7fde-4c2f-ab27-a9969732287a-kube-api-access-mgjlq\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9q9rm\" (UID: \"5e5137c3-7fde-4c2f-ab27-a9969732287a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.596491 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.596395 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:39.731296 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:39.731266 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm"] May 28 16:13:39.733881 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:13:39.733849 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5137c3_7fde_4c2f_ab27_a9969732287a.slice/crio-422abd65f066edca17796e7eb3e71222bb5757d9699f4a63935f6c80faffad29 WatchSource:0}: Error finding container 422abd65f066edca17796e7eb3e71222bb5757d9699f4a63935f6c80faffad29: Status 404 returned error can't find the container with id 422abd65f066edca17796e7eb3e71222bb5757d9699f4a63935f6c80faffad29 May 28 16:13:40.308403 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:40.308370 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" event={"ID":"5e5137c3-7fde-4c2f-ab27-a9969732287a","Type":"ContainerStarted","Data":"127b881ef3e0411d0717d9a078198ab78a64b4be510584faf7d2b8a2c12f590c"} May 28 16:13:40.308403 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:40.308407 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" event={"ID":"5e5137c3-7fde-4c2f-ab27-a9969732287a","Type":"ContainerStarted","Data":"422abd65f066edca17796e7eb3e71222bb5757d9699f4a63935f6c80faffad29"} May 28 16:13:42.286079 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:42.286044 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8" May 28 16:13:45.329274 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:45.329236 2573 generic.go:358] "Generic (PLEG): container finished" podID="5e5137c3-7fde-4c2f-ab27-a9969732287a" containerID="127b881ef3e0411d0717d9a078198ab78a64b4be510584faf7d2b8a2c12f590c" exitCode=0 May 28 16:13:45.329712 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:45.329315 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" event={"ID":"5e5137c3-7fde-4c2f-ab27-a9969732287a","Type":"ContainerDied","Data":"127b881ef3e0411d0717d9a078198ab78a64b4be510584faf7d2b8a2c12f590c"} May 28 16:13:46.334492 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:46.334447 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" event={"ID":"5e5137c3-7fde-4c2f-ab27-a9969732287a","Type":"ContainerStarted","Data":"6270815df0487a4ce810f3e0b246968dae15449351a214f0e3fdc943d39ae5a2"} May 28 16:13:46.334975 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:46.334681 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:13:46.354713 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:46.354657 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" podStartSLOduration=6.894249965 podStartE2EDuration="7.354642433s" podCreationTimestamp="2026-05-28 16:13:39 +0000 UTC" firstStartedPulling="2026-05-28 16:13:45.330024318 +0000 UTC m=+643.812547186" lastFinishedPulling="2026-05-28 16:13:45.790416775 +0000 UTC m=+644.272939654" observedRunningTime="2026-05-28 16:13:46.352660294 +0000 UTC m=+644.835183196" watchObservedRunningTime="2026-05-28 16:13:46.354642433 +0000 UTC m=+644.837165372" May 28 16:13:57.351857 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:13:57.351820 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9q9rm" May 28 16:14:04.775913 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.775873 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz"] May 28 16:14:04.779737 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.779710 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:04.782407 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.782380 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 28 16:14:04.796329 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.796293 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz"] May 28 16:14:04.900724 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.900670 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:04.900911 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.900745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d60e370-5552-4231-97d2-4fe69996beb2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:04.900911 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.900814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskf5\" (UniqueName: \"kubernetes.io/projected/2d60e370-5552-4231-97d2-4fe69996beb2-kube-api-access-lskf5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:04.900994 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.900912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:04.900994 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.900936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:04.900994 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:04.900972 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001405 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001366 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d60e370-5552-4231-97d2-4fe69996beb2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001416 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lskf5\" (UniqueName: \"kubernetes.io/projected/2d60e370-5552-4231-97d2-4fe69996beb2-kube-api-access-lskf5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001459 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001479 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001500 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001583 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001523 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.001975 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001947 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.002056 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.001993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.002056 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.002030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.003830 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.003810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d60e370-5552-4231-97d2-4fe69996beb2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.004132 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.004111 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d60e370-5552-4231-97d2-4fe69996beb2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.009243 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.009222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskf5\" (UniqueName: \"kubernetes.io/projected/2d60e370-5552-4231-97d2-4fe69996beb2-kube-api-access-lskf5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz\" (UID: \"2d60e370-5552-4231-97d2-4fe69996beb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.093851 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.093746 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:05.240219 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.240191 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz"] May 28 16:14:05.241420 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:14:05.241394 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d60e370_5552_4231_97d2_4fe69996beb2.slice/crio-6e01429fe531393983ce5b33f1d4c2d606894f74690ee71c273931eb5466d4e8 WatchSource:0}: Error finding container 6e01429fe531393983ce5b33f1d4c2d606894f74690ee71c273931eb5466d4e8: Status 404 returned error can't find the container with id 6e01429fe531393983ce5b33f1d4c2d606894f74690ee71c273931eb5466d4e8 May 28 16:14:05.408779 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.408672 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" event={"ID":"2d60e370-5552-4231-97d2-4fe69996beb2","Type":"ContainerStarted","Data":"64d0311ad564c9a106d36b0753ce83da9270d62413175f927b7117a26f354f48"} May 28 16:14:05.408779 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:05.408716 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" event={"ID":"2d60e370-5552-4231-97d2-4fe69996beb2","Type":"ContainerStarted","Data":"6e01429fe531393983ce5b33f1d4c2d606894f74690ee71c273931eb5466d4e8"} May 28 16:14:11.432338 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:11.432303 2573 generic.go:358] "Generic (PLEG): container finished" podID="2d60e370-5552-4231-97d2-4fe69996beb2" containerID="64d0311ad564c9a106d36b0753ce83da9270d62413175f927b7117a26f354f48" exitCode=0 May 28 16:14:11.432742 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:11.432373 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" event={"ID":"2d60e370-5552-4231-97d2-4fe69996beb2","Type":"ContainerDied","Data":"64d0311ad564c9a106d36b0753ce83da9270d62413175f927b7117a26f354f48"} May 28 16:14:12.443446 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:12.443409 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" event={"ID":"2d60e370-5552-4231-97d2-4fe69996beb2","Type":"ContainerStarted","Data":"d49627a2939393ae2bdce5a9665e36080b8eb41ed712533799adb2347fdaac3c"} May 28 16:14:12.443857 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:12.443653 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:12.462796 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:12.462733 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" podStartSLOduration=8.027908604 podStartE2EDuration="8.462713797s" podCreationTimestamp="2026-05-28 16:14:04 +0000 UTC" firstStartedPulling="2026-05-28 16:14:11.432995568 +0000 UTC m=+669.915518435" lastFinishedPulling="2026-05-28 16:14:11.867800745 +0000 UTC m=+670.350323628" observedRunningTime="2026-05-28 16:14:12.461713123 +0000 UTC m=+670.944236026" watchObservedRunningTime="2026-05-28 16:14:12.462713797 +0000 UTC m=+670.945236690" May 28 16:14:23.460685 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:23.460652 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz" May 28 16:14:43.176930 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.176888 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c"] May 28 16:14:43.179888 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.179863 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.182582 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.182561 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 28 16:14:43.191962 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.191940 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c"] May 28 16:14:43.226346 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.226312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.226346 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.226349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.226549 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.226376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.226549 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.226424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttfhq\" (UniqueName: \"kubernetes.io/projected/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-kube-api-access-ttfhq\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.226549 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.226458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.226549 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.226478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.327555 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.327514 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.327738 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.327566 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.327738 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.327632 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.327738 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.327657 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.327738 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.327700 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.327738 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.327733 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttfhq\" (UniqueName: \"kubernetes.io/projected/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-kube-api-access-ttfhq\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.328156 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.328130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.328269 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.328170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.328269 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.328129 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.329962 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.329942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.330154 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.330137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.335679 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.335657 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttfhq\" (UniqueName: \"kubernetes.io/projected/7e9c77ac-25b1-40a9-b6f7-a34c776d599a-kube-api-access-ttfhq\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c\" (UID: \"7e9c77ac-25b1-40a9-b6f7-a34c776d599a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.490575 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.490541 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:43.627363 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:43.627333 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c"] May 28 16:14:43.629155 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:14:43.629127 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9c77ac_25b1_40a9_b6f7_a34c776d599a.slice/crio-f55e9184436302ab18fd4698f21bb29cd02015a5bc068e0ac52968c28a22f862 WatchSource:0}: Error finding container f55e9184436302ab18fd4698f21bb29cd02015a5bc068e0ac52968c28a22f862: Status 404 returned error can't find the container with id f55e9184436302ab18fd4698f21bb29cd02015a5bc068e0ac52968c28a22f862 May 28 16:14:44.566146 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:44.566090 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" event={"ID":"7e9c77ac-25b1-40a9-b6f7-a34c776d599a","Type":"ContainerStarted","Data":"ba18ebd7e740ee48420e325035175be3c96808ab7c807d273e947e5fc26c30cc"} May 28 16:14:44.566146 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:44.566154 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" event={"ID":"7e9c77ac-25b1-40a9-b6f7-a34c776d599a","Type":"ContainerStarted","Data":"f55e9184436302ab18fd4698f21bb29cd02015a5bc068e0ac52968c28a22f862"} May 28 16:14:49.586412 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:49.586376 2573 generic.go:358] "Generic (PLEG): container finished" podID="7e9c77ac-25b1-40a9-b6f7-a34c776d599a" containerID="ba18ebd7e740ee48420e325035175be3c96808ab7c807d273e947e5fc26c30cc" exitCode=0 May 28 16:14:49.586812 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:49.586451 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" event={"ID":"7e9c77ac-25b1-40a9-b6f7-a34c776d599a","Type":"ContainerDied","Data":"ba18ebd7e740ee48420e325035175be3c96808ab7c807d273e947e5fc26c30cc"} May 28 16:14:50.591474 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:50.591438 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" event={"ID":"7e9c77ac-25b1-40a9-b6f7-a34c776d599a","Type":"ContainerStarted","Data":"2c5b4cddf53427afb4994b1af8ce9b3c137adca295a4aed1f63968872ad80733"} May 28 16:14:50.591870 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:50.591669 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:14:50.609639 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:14:50.609587 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" podStartSLOduration=7.077204033 podStartE2EDuration="7.609572274s" podCreationTimestamp="2026-05-28 16:14:43 +0000 UTC" firstStartedPulling="2026-05-28 16:14:49.58713043 +0000 UTC m=+708.069653300" lastFinishedPulling="2026-05-28 16:14:50.11949867 +0000 UTC m=+708.602021541" observedRunningTime="2026-05-28 16:14:50.608410704 +0000 UTC m=+709.090933594" watchObservedRunningTime="2026-05-28 16:14:50.609572274 +0000 UTC m=+709.092095184" May 28 16:15:01.608727 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:15:01.608696 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c" May 28 16:16:24.321661 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.321557 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdc447758-56kd6"] May 28 16:16:24.322147 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.321882 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6fdc447758-56kd6" podUID="6701d582-fe41-4c6b-80cb-80ca62a32f0f" containerName="manager" containerID="cri-o://a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93" gracePeriod=30 May 28 16:16:24.566399 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.566373 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:16:24.619211 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.619129 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjzxl\" (UniqueName: \"kubernetes.io/projected/6701d582-fe41-4c6b-80cb-80ca62a32f0f-kube-api-access-qjzxl\") pod \"6701d582-fe41-4c6b-80cb-80ca62a32f0f\" (UID: \"6701d582-fe41-4c6b-80cb-80ca62a32f0f\") " May 28 16:16:24.621232 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.621204 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6701d582-fe41-4c6b-80cb-80ca62a32f0f-kube-api-access-qjzxl" (OuterVolumeSpecName: "kube-api-access-qjzxl") pod "6701d582-fe41-4c6b-80cb-80ca62a32f0f" (UID: "6701d582-fe41-4c6b-80cb-80ca62a32f0f"). InnerVolumeSpecName "kube-api-access-qjzxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 16:16:24.719801 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.719763 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjzxl\" (UniqueName: \"kubernetes.io/projected/6701d582-fe41-4c6b-80cb-80ca62a32f0f-kube-api-access-qjzxl\") on node \"ip-10-0-134-197.ec2.internal\" DevicePath \"\"" May 28 16:16:24.949012 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.948929 2573 generic.go:358] "Generic (PLEG): container finished" podID="6701d582-fe41-4c6b-80cb-80ca62a32f0f" containerID="a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93" exitCode=0 May 28 16:16:24.949012 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.948992 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc447758-56kd6" May 28 16:16:24.949201 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.949019 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc447758-56kd6" event={"ID":"6701d582-fe41-4c6b-80cb-80ca62a32f0f","Type":"ContainerDied","Data":"a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93"} May 28 16:16:24.949201 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.949074 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc447758-56kd6" event={"ID":"6701d582-fe41-4c6b-80cb-80ca62a32f0f","Type":"ContainerDied","Data":"d1660d14c4f81381298a63234845d24c8732a21aa8755b65ca22f5752b2d6d95"} May 28 16:16:24.949201 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.949090 2573 scope.go:117] "RemoveContainer" containerID="a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93" May 28 16:16:24.957826 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.957809 2573 scope.go:117] "RemoveContainer" containerID="a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93" May 28 16:16:24.958068 ip-10-0-134-197 kubenswrapper[2573]: E0528 16:16:24.958050 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93\": container with ID starting with a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93 not found: ID does not exist" containerID="a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93" May 28 16:16:24.958165 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.958081 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93"} err="failed to get container status \"a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93\": rpc error: code = NotFound desc = could not find container \"a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93\": container with ID starting with a4b3196d076f9a2d8dba15c15202c445cce9631b3eb4d6a6a798e6068dd19b93 not found: ID does not exist" May 28 16:16:24.970628 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.970605 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdc447758-56kd6"] May 28 16:16:24.974794 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:24.974771 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fdc447758-56kd6"] May 28 16:16:25.741236 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.741197 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fdc447758-wffjl"] May 28 16:16:25.741614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.741517 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6701d582-fe41-4c6b-80cb-80ca62a32f0f" containerName="manager" May 28 16:16:25.741614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.741528 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6701d582-fe41-4c6b-80cb-80ca62a32f0f" containerName="manager" May 28 16:16:25.741614 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.741604 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="6701d582-fe41-4c6b-80cb-80ca62a32f0f" containerName="manager" May 28 16:16:25.743579 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.743562 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:16:25.745954 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.745928 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 28 16:16:25.746069 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.745938 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9v4rs\"" May 28 16:16:25.756728 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.756707 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc447758-wffjl"] May 28 16:16:25.831798 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.831750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zljmh\" (UniqueName: \"kubernetes.io/projected/7eac3d20-3c03-4131-997a-6d3b8d9a42cd-kube-api-access-zljmh\") pod \"maas-controller-6fdc447758-wffjl\" (UID: \"7eac3d20-3c03-4131-997a-6d3b8d9a42cd\") " pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:16:25.933365 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.933326 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zljmh\" (UniqueName: \"kubernetes.io/projected/7eac3d20-3c03-4131-997a-6d3b8d9a42cd-kube-api-access-zljmh\") pod \"maas-controller-6fdc447758-wffjl\" (UID: \"7eac3d20-3c03-4131-997a-6d3b8d9a42cd\") " pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:16:25.941503 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:25.941476 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zljmh\" (UniqueName: \"kubernetes.io/projected/7eac3d20-3c03-4131-997a-6d3b8d9a42cd-kube-api-access-zljmh\") pod \"maas-controller-6fdc447758-wffjl\" (UID: \"7eac3d20-3c03-4131-997a-6d3b8d9a42cd\") " pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:16:26.054027 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.053933 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:16:26.083920 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.083885 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6701d582-fe41-4c6b-80cb-80ca62a32f0f" path="/var/lib/kubelet/pods/6701d582-fe41-4c6b-80cb-80ca62a32f0f/volumes" May 28 16:16:26.191348 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:16:26.191307 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eac3d20_3c03_4131_997a_6d3b8d9a42cd.slice/crio-50b3cb957f273842964ebb42b429882d9e03b04ccd0c6b4c3af65916d05fe2e0 WatchSource:0}: Error finding container 50b3cb957f273842964ebb42b429882d9e03b04ccd0c6b4c3af65916d05fe2e0: Status 404 returned error can't find the container with id 50b3cb957f273842964ebb42b429882d9e03b04ccd0c6b4c3af65916d05fe2e0 May 28 16:16:26.192444 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.192413 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdc447758-wffjl"] May 28 16:16:26.958345 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.958249 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc447758-wffjl" event={"ID":"7eac3d20-3c03-4131-997a-6d3b8d9a42cd","Type":"ContainerStarted","Data":"6be559d7e85954bb609c7f1f5a9b3c0987f03c0ccbec8dea94689fa89688e0a6"} May 28 16:16:26.958345 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.958297 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdc447758-wffjl" event={"ID":"7eac3d20-3c03-4131-997a-6d3b8d9a42cd","Type":"ContainerStarted","Data":"50b3cb957f273842964ebb42b429882d9e03b04ccd0c6b4c3af65916d05fe2e0"} May 28 16:16:26.958773 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.958461 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:16:26.975484 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:26.975427 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6fdc447758-wffjl" podStartSLOduration=1.593808517 podStartE2EDuration="1.97541166s" podCreationTimestamp="2026-05-28 16:16:25 +0000 UTC" firstStartedPulling="2026-05-28 16:16:26.192630581 +0000 UTC m=+804.675153460" lastFinishedPulling="2026-05-28 16:16:26.574233723 +0000 UTC m=+805.056756603" observedRunningTime="2026-05-28 16:16:26.975030878 +0000 UTC m=+805.457553765" watchObservedRunningTime="2026-05-28 16:16:26.97541166 +0000 UTC m=+805.457934550" May 28 16:16:37.970463 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:16:37.970431 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fdc447758-wffjl" May 28 16:18:02.029550 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:18:02.029467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:18:02.030176 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:18:02.029892 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:23:02.059735 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:23:02.059704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:23:02.062004 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:23:02.061979 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:28:02.091729 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:28:02.091699 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:28:02.094932 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:28:02.094909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:33:02.125365 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:33:02.125251 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:33:02.130502 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:33:02.130480 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:37:38.500408 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:38.500335 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64cb5dc64b-pd4zv_76395b1f-6945-4fda-b05c-8d12e13f5e2d/maas-api/0.log" May 28 16:37:38.831320 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:38.831218 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6fdc447758-wffjl_7eac3d20-3c03-4131-997a-6d3b8d9a42cd/manager/0.log" May 28 16:37:38.947612 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:38.947584 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-q6nhm_f2365e29-bec3-48ba-8f1c-fb990e1d97e6/manager/2.log" May 28 16:37:39.183211 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:39.183135 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-864b4b584-96rmn_8bb68819-2a08-4172-a39d-a8497922d165/manager/0.log" May 28 16:37:39.402387 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:39.402344 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-sswrm_e1727035-3479-4e93-b6bb-10e247e5efe9/postgres/0.log" May 28 16:37:40.148737 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.148707 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn_cbf10869-10cf-4cb1-8ebd-b8246665b64e/util/0.log" May 28 16:37:40.154625 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.154603 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn_cbf10869-10cf-4cb1-8ebd-b8246665b64e/pull/0.log" May 28 16:37:40.159945 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.159930 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn_cbf10869-10cf-4cb1-8ebd-b8246665b64e/extract/0.log" May 28 16:37:40.267637 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.267604 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh_685c55be-fd3f-4ecc-83f7-9cb46a6d94de/util/0.log" May 28 16:37:40.273678 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.273655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh_685c55be-fd3f-4ecc-83f7-9cb46a6d94de/pull/0.log" May 28 16:37:40.279593 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.279576 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh_685c55be-fd3f-4ecc-83f7-9cb46a6d94de/extract/0.log" May 28 16:37:40.386609 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.386579 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp_08b1286a-0ac0-4dc6-8158-f692ea9cd432/util/0.log" May 28 16:37:40.394619 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.394596 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp_08b1286a-0ac0-4dc6-8158-f692ea9cd432/pull/0.log" May 28 16:37:40.401277 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.401217 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp_08b1286a-0ac0-4dc6-8158-f692ea9cd432/extract/0.log" May 28 16:37:40.506664 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.506626 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm_aec2f588-890c-44f9-8056-aa42af7c072a/util/0.log" May 28 16:37:40.511708 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.511686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm_aec2f588-890c-44f9-8056-aa42af7c072a/pull/0.log" May 28 16:37:40.516640 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:40.516623 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm_aec2f588-890c-44f9-8056-aa42af7c072a/extract/0.log" May 28 16:37:41.909413 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:41.909380 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5p8nt_bc747337-99cb-46bb-918e-2b231993bc90/discovery/0.log" May 28 16:37:42.362382 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:42.362348 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-gq7gj_0bd2176a-2822-4159-8d65-9367bdfeca3d/payload-processing/0.log" May 28 16:37:42.948218 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:42.948191 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c_7e9c77ac-25b1-40a9-b6f7-a34c776d599a/storage-initializer/0.log" May 28 16:37:42.955112 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:42.955083 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-77f6c_7e9c77ac-25b1-40a9-b6f7-a34c776d599a/main/0.log" May 28 16:37:43.063167 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:43.063137 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-9q9rm_5e5137c3-7fde-4c2f-ab27-a9969732287a/storage-initializer/0.log" May 28 16:37:43.074604 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:43.074580 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-9q9rm_5e5137c3-7fde-4c2f-ab27-a9969732287a/main/0.log" May 28 16:37:43.180845 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:43.180817 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz_2d60e370-5552-4231-97d2-4fe69996beb2/main/0.log" May 28 16:37:43.186729 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:43.186709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccptvhz_2d60e370-5552-4231-97d2-4fe69996beb2/storage-initializer/0.log" May 28 16:37:43.295214 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:43.295188 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8_8aae692f-6b84-4665-b3ee-0687ac3584c2/storage-initializer/0.log" May 28 16:37:43.301811 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:43.301791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-8pwj8_8aae692f-6b84-4665-b3ee-0687ac3584c2/main/0.log" May 28 16:37:50.547671 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:50.547643 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j9sl5_b47b49db-ae4c-4948-b0e5-d76e5f8e64ff/global-pull-secret-syncer/0.log" May 28 16:37:50.765823 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:50.765780 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rxhqb_20ba681e-ddad-4d53-a198-f3f21390d65d/konnectivity-agent/0.log" May 28 16:37:50.783858 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:50.783825 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-197.ec2.internal_fcf920ea05c3c7ff41d5c3afce1571e9/haproxy/0.log" May 28 16:37:54.466298 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.466267 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn_cbf10869-10cf-4cb1-8ebd-b8246665b64e/extract/0.log" May 28 16:37:54.486761 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.486730 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn_cbf10869-10cf-4cb1-8ebd-b8246665b64e/util/0.log" May 28 16:37:54.508624 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.508595 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xllrn_cbf10869-10cf-4cb1-8ebd-b8246665b64e/pull/0.log" May 28 16:37:54.531409 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.531384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh_685c55be-fd3f-4ecc-83f7-9cb46a6d94de/extract/0.log" May 28 16:37:54.549589 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.549561 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh_685c55be-fd3f-4ecc-83f7-9cb46a6d94de/util/0.log" May 28 16:37:54.567708 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.567687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw2wh_685c55be-fd3f-4ecc-83f7-9cb46a6d94de/pull/0.log" May 28 16:37:54.594962 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.594940 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp_08b1286a-0ac0-4dc6-8158-f692ea9cd432/extract/0.log" May 28 16:37:54.621104 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.621079 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp_08b1286a-0ac0-4dc6-8158-f692ea9cd432/util/0.log" May 28 16:37:54.635161 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.635135 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mqjp_08b1286a-0ac0-4dc6-8158-f692ea9cd432/pull/0.log" May 28 16:37:54.660738 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.660714 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm_aec2f588-890c-44f9-8056-aa42af7c072a/extract/0.log" May 28 16:37:54.680974 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.680953 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm_aec2f588-890c-44f9-8056-aa42af7c072a/util/0.log" May 28 16:37:54.701528 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:54.701502 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tzttm_aec2f588-890c-44f9-8056-aa42af7c072a/pull/0.log" May 28 16:37:57.150042 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:57.150012 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2dgh2_9bb45cfc-b365-4eb6-8e01-02037ffa6b16/node-exporter/0.log" May 28 16:37:57.173499 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:57.173477 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2dgh2_9bb45cfc-b365-4eb6-8e01-02037ffa6b16/kube-rbac-proxy/0.log" May 28 16:37:57.196983 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:57.196956 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2dgh2_9bb45cfc-b365-4eb6-8e01-02037ffa6b16/init-textfile/0.log" May 28 16:37:59.160997 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.160958 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq"] May 28 16:37:59.163282 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.163266 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.165640 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.165620 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8x6z2\"/\"openshift-service-ca.crt\"" May 28 16:37:59.166496 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.166478 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8x6z2\"/\"default-dockercfg-fd2fx\"" May 28 16:37:59.166554 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.166486 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8x6z2\"/\"kube-root-ca.crt\"" May 28 16:37:59.171345 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.171323 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq"] May 28 16:37:59.268365 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.268328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-proc\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.268365 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.268371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-podres\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.268617 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.268395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-lib-modules\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.268617 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.268532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-sys\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.268617 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.268581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb86h\" (UniqueName: \"kubernetes.io/projected/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-kube-api-access-fb86h\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369368 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369327 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-podres\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369368 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369369 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-lib-modules\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369421 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-sys\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369451 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fb86h\" (UniqueName: \"kubernetes.io/projected/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-kube-api-access-fb86h\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369471 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-proc\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369525 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-lib-modules\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-proc\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369526 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-podres\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.369613 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.369558 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-sys\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.376688 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.376659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb86h\" (UniqueName: \"kubernetes.io/projected/94dfa07b-7ecb-4e4b-9ee7-efaa478848b4-kube-api-access-fb86h\") pod \"perf-node-gather-daemonset-q49nq\" (UID: \"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4\") " pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.474151 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.474052 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.603537 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.603510 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq"] May 28 16:37:59.606126 ip-10-0-134-197 kubenswrapper[2573]: W0528 16:37:59.606069 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94dfa07b_7ecb_4e4b_9ee7_efaa478848b4.slice/crio-e116f569534d5528d0e976f0da8537c164bbe29cab7391508316e6b8cd5f7df2 WatchSource:0}: Error finding container e116f569534d5528d0e976f0da8537c164bbe29cab7391508316e6b8cd5f7df2: Status 404 returned error can't find the container with id e116f569534d5528d0e976f0da8537c164bbe29cab7391508316e6b8cd5f7df2 May 28 16:37:59.610340 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.610317 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 16:37:59.904031 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.903995 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" event={"ID":"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4","Type":"ContainerStarted","Data":"80cd3f539ee0d4e10c2145901444d59dd7d2a5ceac111e7d46104b8c9543f7dd"} May 28 16:37:59.904031 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.904033 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" event={"ID":"94dfa07b-7ecb-4e4b-9ee7-efaa478848b4","Type":"ContainerStarted","Data":"e116f569534d5528d0e976f0da8537c164bbe29cab7391508316e6b8cd5f7df2"} May 28 16:37:59.904276 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.904128 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:37:59.918645 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:37:59.918581 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" podStartSLOduration=0.91856277 podStartE2EDuration="918.56277ms" podCreationTimestamp="2026-05-28 16:37:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:37:59.917183982 +0000 UTC m=+2098.399706873" watchObservedRunningTime="2026-05-28 16:37:59.91856277 +0000 UTC m=+2098.401085661" May 28 16:38:01.088572 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:01.088538 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64mlt_94e87f7f-08b8-489e-a3de-ba6860bd4a43/dns/0.log" May 28 16:38:01.106555 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:01.106530 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64mlt_94e87f7f-08b8-489e-a3de-ba6860bd4a43/kube-rbac-proxy/0.log" May 28 16:38:01.165640 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:01.165613 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2s8jv_8119d146-3ceb-4b3c-b3eb-aed911148eb1/dns-node-resolver/0.log" May 28 16:38:01.701998 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:01.701963 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sgbgp_16ca51ba-634c-4874-ad88-bf0cbd979736/node-ca/0.log" May 28 16:38:02.154605 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:02.154497 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:38:02.167812 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:02.161976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-197.ec2.internal_6ae5e75a733961f8d5a9aefe5c4d68d1/kube-rbac-proxy-crio/1.log" May 28 16:38:02.535622 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:02.535589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5p8nt_bc747337-99cb-46bb-918e-2b231993bc90/discovery/0.log" May 28 16:38:02.707428 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:02.707392 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-gq7gj_0bd2176a-2822-4159-8d65-9367bdfeca3d/payload-processing/0.log" May 28 16:38:03.267427 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:03.267397 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-glzgk_7b2581e8-370f-42d7-ac17-b6b07581dc04/serve-healthcheck-canary/0.log" May 28 16:38:03.794200 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:03.794168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgdz7_0c102c78-43aa-4aae-855c-56de3c87a7d4/kube-rbac-proxy/0.log" May 28 16:38:03.811894 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:03.811863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgdz7_0c102c78-43aa-4aae-855c-56de3c87a7d4/exporter/0.log" May 28 16:38:03.830444 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:03.830420 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgdz7_0c102c78-43aa-4aae-855c-56de3c87a7d4/extractor/0.log" May 28 16:38:05.746627 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.746601 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64cb5dc64b-pd4zv_76395b1f-6945-4fda-b05c-8d12e13f5e2d/maas-api/0.log" May 28 16:38:05.847067 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.847033 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6fdc447758-wffjl_7eac3d20-3c03-4131-997a-6d3b8d9a42cd/manager/0.log" May 28 16:38:05.864219 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.864194 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-q6nhm_f2365e29-bec3-48ba-8f1c-fb990e1d97e6/manager/1.log" May 28 16:38:05.874900 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.874878 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-q6nhm_f2365e29-bec3-48ba-8f1c-fb990e1d97e6/manager/2.log" May 28 16:38:05.918104 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.918070 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8x6z2/perf-node-gather-daemonset-q49nq" May 28 16:38:05.951846 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.951820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-864b4b584-96rmn_8bb68819-2a08-4172-a39d-a8497922d165/manager/0.log" May 28 16:38:05.996989 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:05.996915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-sswrm_e1727035-3479-4e93-b6bb-10e247e5efe9/postgres/0.log" May 28 16:38:07.052183 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:07.052156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64d695c68d-t4nf6_2f4c7b19-ac2b-495e-ad45-ac9fd4383116/manager/0.log" May 28 16:38:07.076020 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:07.075992 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-jh27p_217e09c9-7d01-4bc7-9403-4228e59471a4/openshift-lws-operator/0.log" May 28 16:38:12.480941 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.480910 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bpn8_5a8a8fbb-e4c7-4b8f-b133-b2304127fdc5/kube-multus/0.log" May 28 16:38:12.778633 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.778541 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/kube-multus-additional-cni-plugins/0.log" May 28 16:38:12.797395 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.797371 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/egress-router-binary-copy/0.log" May 28 16:38:12.815408 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.815378 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/cni-plugins/0.log" May 28 16:38:12.833604 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.833579 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/bond-cni-plugin/0.log" May 28 16:38:12.854185 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.854155 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/routeoverride-cni/0.log" May 28 16:38:12.873333 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.873304 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/whereabouts-cni-bincopy/0.log" May 28 16:38:12.891749 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:12.891720 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qgg76_42537c4c-0d27-4aae-9620-a1ee4b1cbb47/whereabouts-cni/0.log" May 28 16:38:13.014752 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:13.014720 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pswbq_a1b0dac5-1ebf-4aac-a379-618a1b7d86bb/network-metrics-daemon/0.log" May 28 16:38:13.033253 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:13.033173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pswbq_a1b0dac5-1ebf-4aac-a379-618a1b7d86bb/kube-rbac-proxy/0.log" May 28 16:38:14.276937 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.276910 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/ovn-controller/0.log" May 28 16:38:14.303816 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.303795 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/ovn-acl-logging/0.log" May 28 16:38:14.317820 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.317801 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/kube-rbac-proxy-node/0.log" May 28 16:38:14.336289 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.336252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/kube-rbac-proxy-ovn-metrics/0.log" May 28 16:38:14.353823 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.353802 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/northd/0.log" May 28 16:38:14.371609 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.371585 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/nbdb/0.log" May 28 16:38:14.391516 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.391490 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/sbdb/0.log" May 28 16:38:14.496525 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:14.496494 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dk7tr_5a35837a-20df-4283-880e-abe6a85b12c5/ovnkube-controller/0.log" May 28 16:38:15.895230 ip-10-0-134-197 kubenswrapper[2573]: I0528 16:38:15.895202 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nq2bl_9d633331-04cc-4ebd-b1be-b3d2fab53be8/network-check-target-container/0.log"