May 25 07:33:24.431812 ip-10-0-133-15 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 25 07:33:24.431824 ip-10-0-133-15 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 25 07:33:24.431833 ip-10-0-133-15 systemd[1]: kubelet.service: Failed with result 'resources'. May 25 07:33:24.432134 ip-10-0-133-15 systemd[1]: Failed to start Kubernetes Kubelet. May 25 07:33:33.750053 ip-10-0-133-15 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. May 25 07:33:33.750065 ip-10-0-133-15 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dc886bdcca764d738b7a2e376f074dbf -- May 25 07:35:54.007652 ip-10-0-133-15 systemd[1]: Starting Kubernetes Kubelet... May 25 07:35:54.522528 ip-10-0-133-15 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 07:35:54.522528 ip-10-0-133-15 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 07:35:54.522528 ip-10-0-133-15 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 07:35:54.522528 ip-10-0-133-15 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 07:35:54.522528 ip-10-0-133-15 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 07:35:54.524489 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.524398 2550 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 07:35:54.528681 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528666 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 07:35:54.528681 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528682 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528686 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528690 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528692 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528696 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528699 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528701 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528704 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528707 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528709 2550 feature_gate.go:328] unrecognized feature gate: Example May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528712 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528714 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528717 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528733 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528736 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528739 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528741 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528744 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528746 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528749 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 07:35:54.528751 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528753 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528757 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528760 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528763 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528766 2550 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528768 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528770 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528773 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528775 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528778 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528781 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528783 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528786 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528788 2550 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528791 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528793 2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528795 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528798 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528800 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528802 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 07:35:54.529221 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528805 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528807 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528810 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528813 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528816 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528818 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528820 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528823 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528825 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528827 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528830 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528833 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528836 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528839 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528842 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528845 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528848 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528850 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528853 2550 feature_gate.go:328] unrecognized feature gate: Example2 May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528855 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 07:35:54.529748 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528858 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528860 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528862 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528865 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528867 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528870 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528873 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528875 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528878 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528880 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528883 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528886 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528889 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528891 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528896 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528900 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528902 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528905 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528908 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 07:35:54.530322 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528911 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528914 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528917 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528919 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528922 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.528925 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529342 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529349 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529352 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529355 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529357 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529360 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529363 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529367 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529372 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529376 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529379 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529383 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529386 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529389 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 07:35:54.530785 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529391 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529394 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529397 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529399 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529402 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529404 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529407 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529409 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529412 2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529414 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529416 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529419 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529421 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529424 2550 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529427 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529429 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529431 2550 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529434 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529437 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529440 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 07:35:54.531259 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529443 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529445 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529447 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529450 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529453 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529456 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529458 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529462 2550 feature_gate.go:328] unrecognized feature gate: Example May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529464 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529467 2550 feature_gate.go:328] unrecognized feature gate: Example2 May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529469 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529473 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529475 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529478 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529480 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529483 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529486 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529488 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529491 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 07:35:54.531778 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529495 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529498 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529501 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529504 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529507 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529509 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529511 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529514 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529516 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529519 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529521 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529524 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529527 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529530 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529532 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529535 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529537 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529540 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529542 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529545 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 07:35:54.532246 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529547 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529550 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529552 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529554 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529558 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529561 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529564 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529567 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529569 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529571 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529574 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529576 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.529579 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529662 2550 flags.go:64] FLAG: --address="0.0.0.0" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529669 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529676 2550 flags.go:64] FLAG: --anonymous-auth="true" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529681 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529685 2550 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529688 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529693 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529698 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 07:35:54.532787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529701 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529704 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529708 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529711 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529714 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529717 2550 flags.go:64] FLAG: --cgroup-root="" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529720 2550 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529722 2550 flags.go:64] FLAG: --client-ca-file="" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529725 2550 flags.go:64] FLAG: --cloud-config="" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529727 2550 flags.go:64] FLAG: --cloud-provider="external" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529730 2550 flags.go:64] FLAG: --cluster-dns="[]" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529734 2550 flags.go:64] FLAG: --cluster-domain="" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529737 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529740 2550 flags.go:64] FLAG: --config-dir="" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529743 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529746 2550 flags.go:64] FLAG: --container-log-max-files="5" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529750 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529754 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529757 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529760 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529763 2550 flags.go:64] FLAG: --contention-profiling="false" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529766 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529769 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529772 2550 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529775 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 07:35:54.533287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529779 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529782 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529785 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529789 2550 flags.go:64] FLAG: --enable-load-reader="false" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529791 2550 flags.go:64] FLAG: --enable-server="true" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529794 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529799 2550 flags.go:64] FLAG: --event-burst="100" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529802 2550 flags.go:64] FLAG: --event-qps="50" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529805 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529808 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529811 2550 flags.go:64] FLAG: --eviction-hard="" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529815 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529817 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529821 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529823 2550 flags.go:64] FLAG: --eviction-soft="" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529826 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529829 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529832 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529835 2550 flags.go:64] FLAG: --experimental-mounter-path="" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529837 2550 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529840 2550 flags.go:64] FLAG: --fail-swap-on="true" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529843 2550 flags.go:64] FLAG: --feature-gates="" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529846 2550 flags.go:64] FLAG: --file-check-frequency="20s" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529849 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529852 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 07:35:54.533890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529856 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529859 2550 flags.go:64] FLAG: --healthz-port="10248" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529863 2550 flags.go:64] FLAG: --help="false" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529866 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-133-15.ec2.internal" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529869 2550 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529871 2550 flags.go:64] FLAG: --http-check-frequency="20s" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529875 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529879 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529882 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529885 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529888 2550 flags.go:64] FLAG: --image-service-endpoint="" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529891 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529894 2550 flags.go:64] FLAG: --kube-api-burst="100" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529897 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529900 2550 flags.go:64] FLAG: --kube-api-qps="50" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529902 2550 flags.go:64] FLAG: --kube-reserved="" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529905 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529908 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529911 2550 flags.go:64] FLAG: --kubelet-cgroups="" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529914 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529917 2550 flags.go:64] FLAG: --lock-file="" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529919 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529922 2550 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529925 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 07:35:54.534503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529930 2550 flags.go:64] FLAG: --log-json-split-stream="false" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529933 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529936 2550 flags.go:64] FLAG: --log-text-split-stream="false" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529938 2550 flags.go:64] FLAG: --logging-format="text" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529941 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529945 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529947 2550 flags.go:64] FLAG: --manifest-url="" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529950 2550 flags.go:64] FLAG: --manifest-url-header="" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529954 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529960 2550 flags.go:64] FLAG: --max-open-files="1000000" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529964 2550 flags.go:64] FLAG: --max-pods="110" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529967 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529970 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529973 2550 flags.go:64] FLAG: --memory-manager-policy="None" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529976 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529979 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529982 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529985 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529993 2550 flags.go:64] FLAG: --node-status-max-images="50" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529996 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.529999 2550 flags.go:64] FLAG: --oom-score-adj="-999" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530001 2550 flags.go:64] FLAG: --pod-cidr="" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530004 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 07:35:54.535081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530010 2550 flags.go:64] FLAG: --pod-manifest-path="" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530013 2550 flags.go:64] FLAG: --pod-max-pids="-1" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530017 2550 flags.go:64] FLAG: --pods-per-core="0" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530020 2550 flags.go:64] FLAG: --port="10250" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530023 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530026 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d3a36f6c971c822a" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530029 2550 flags.go:64] FLAG: --qos-reserved="" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530032 2550 flags.go:64] FLAG: --read-only-port="10255" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530035 2550 flags.go:64] FLAG: --register-node="true" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530037 2550 flags.go:64] FLAG: --register-schedulable="true" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530040 2550 flags.go:64] FLAG: --register-with-taints="" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530044 2550 flags.go:64] FLAG: --registry-burst="10" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530047 2550 flags.go:64] FLAG: --registry-qps="5" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530049 2550 flags.go:64] FLAG: --reserved-cpus="" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530052 2550 flags.go:64] FLAG: --reserved-memory="" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530056 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530059 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530062 2550 flags.go:64] FLAG: --rotate-certificates="false" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530065 2550 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530069 2550 flags.go:64] FLAG: --runonce="false" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530072 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530075 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530078 2550 flags.go:64] FLAG: --seccomp-default="false" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530081 2550 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530083 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530086 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 07:35:54.535659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530090 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530092 2550 flags.go:64] FLAG: --storage-driver-password="root" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530095 2550 flags.go:64] FLAG: --storage-driver-secure="false" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530098 2550 flags.go:64] FLAG: --storage-driver-table="stats" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530101 2550 flags.go:64] FLAG: --storage-driver-user="root" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530104 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530107 2550 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530110 2550 flags.go:64] FLAG: --system-cgroups="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530113 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530118 2550 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530120 2550 flags.go:64] FLAG: --tls-cert-file="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530123 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530127 2550 flags.go:64] FLAG: --tls-min-version="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530130 2550 flags.go:64] FLAG: --tls-private-key-file="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530133 2550 flags.go:64] FLAG: --topology-manager-policy="none" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530135 2550 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530138 2550 flags.go:64] FLAG: --topology-manager-scope="container" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530141 2550 flags.go:64] FLAG: --v="2" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530149 2550 flags.go:64] FLAG: --version="false" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530153 2550 flags.go:64] FLAG: --vmodule="" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530158 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530161 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530250 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530254 2550 feature_gate.go:328] unrecognized feature gate: Example May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530257 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 07:35:54.536282 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530261 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530264 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530267 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530270 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530273 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530276 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530279 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530281 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530285 2550 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530287 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530289 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530292 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530295 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530298 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530300 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530303 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530305 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530308 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530325 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530328 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 07:35:54.536890 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530330 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530333 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530336 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530338 2550 feature_gate.go:328] unrecognized feature gate: Example2 May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530341 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530378 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530384 2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530388 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530391 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530394 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530397 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530400 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530402 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530405 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530408 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530411 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530417 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530422 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530425 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 07:35:54.537435 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530429 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530431 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530434 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530437 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530440 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530442 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530445 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530448 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530450 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530453 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530455 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530459 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530461 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530466 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530469 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530472 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530474 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530477 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530480 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 07:35:54.537903 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530484 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530487 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530490 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530492 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530495 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530497 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530500 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530502 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530505 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530508 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530510 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530512 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530515 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530517 2550 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530520 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530522 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530524 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530527 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530530 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530533 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 07:35:54.538382 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530535 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530538 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530541 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530544 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.530547 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.530558 2550 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.537665 2550 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.537683 2550 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537732 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537738 2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537742 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537745 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537748 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537750 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537753 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 07:35:54.538861 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537758 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537762 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537765 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537768 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537770 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537773 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537776 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537778 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537781 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537784 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537787 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537789 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537792 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537794 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537797 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537799 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537802 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537804 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537807 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537809 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 07:35:54.539238 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537812 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537815 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537817 2550 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537820 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537823 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537825 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537828 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537830 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537833 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537836 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537838 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537841 2550 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537844 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537847 2550 feature_gate.go:328] unrecognized feature gate: Example May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537851 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537854 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537858 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537860 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537863 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 07:35:54.539736 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537865 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537868 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537870 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537873 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537875 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537877 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537880 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537882 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537885 2550 feature_gate.go:328] unrecognized feature gate: Example2 May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537887 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537889 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537892 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537894 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537897 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537899 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537902 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537905 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537908 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537911 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537913 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 07:35:54.540202 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537916 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537918 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537921 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537923 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537926 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537928 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537930 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537933 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537935 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537938 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537940 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537943 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537945 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537947 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537950 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537952 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537954 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537957 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537959 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 07:35:54.540729 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.537961 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.537967 2550 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538062 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538067 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538070 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538073 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538076 2550 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538078 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538081 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538083 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538086 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538089 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538092 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538094 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538097 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538099 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 07:35:54.541196 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538101 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538104 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538106 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538109 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538111 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538114 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538116 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538119 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538121 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538124 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538126 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538128 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538131 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538134 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538136 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538139 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538141 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538143 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538146 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538148 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 07:35:54.541647 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538150 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538168 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538172 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538175 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538178 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538181 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538184 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538188 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538192 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538194 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538197 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538199 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538202 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538204 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538207 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538209 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538212 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538215 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538218 2550 feature_gate.go:328] unrecognized feature gate: Example2 May 25 07:35:54.542549 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538220 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538223 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538226 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538228 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538231 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538233 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538236 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538238 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538240 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538243 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538245 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538248 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538250 2550 feature_gate.go:328] unrecognized feature gate: Example May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538253 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538256 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538259 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538262 2550 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538265 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538268 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 07:35:54.543033 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538271 2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538274 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538277 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538279 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538282 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538284 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538287 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538289 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538292 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538294 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538297 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538299 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538302 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:54.538305 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.538323 2550 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 07:35:54.543507 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.539252 2550 server.go:962] "Client rotation is on, will bootstrap in background" May 25 07:35:54.543884 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.541763 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 07:35:54.543884 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.542963 2550 server.go:1019] "Starting client certificate rotation" May 25 07:35:54.543884 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.543062 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 07:35:54.543965 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.543918 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 07:35:54.573394 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.573371 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 07:35:54.576875 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.576851 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 07:35:54.587250 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.587228 2550 log.go:25] "Validated CRI v1 runtime API" May 25 07:35:54.593427 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.593411 2550 log.go:25] "Validated CRI v1 image API" May 25 07:35:54.599455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.599430 2550 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 07:35:54.602719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.602689 2550 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b94d2f25-5357-47ba-b1a7-d3d4dbd32a84:/dev/nvme0n1p4 d07ab812-3d72-46d8-a878-96595687ea00:/dev/nvme0n1p3] May 25 07:35:54.602809 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.602718 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 07:35:54.605390 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.605371 2550 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 07:35:54.607196 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.607080 2550 manager.go:217] Machine: {Timestamp:2026-05-25 07:35:54.606566268 +0000 UTC m=+0.466465882 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110705 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24988d44702e742f1e696463dcdce2 SystemUUID:ec24988d-4470-2e74-2f1e-696463dcdce2 BootID:dc886bdc-ca76-4d73-8b7a-2e376f074dbf Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:73:28:b5:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:73:28:b5:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:98:3f:d5:df:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 07:35:54.607196 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.607188 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 07:35:54.607385 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.607300 2550 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 07:35:54.610450 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.610419 2550 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 07:35:54.610629 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.610452 2550 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 07:35:54.610719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.610644 2550 topology_manager.go:138] "Creating topology manager with none policy" May 25 07:35:54.610719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.610656 2550 container_manager_linux.go:306] "Creating device plugin manager" May 25 07:35:54.610719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.610673 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 07:35:54.610719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.610697 2550 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 07:35:54.613426 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.613412 2550 state_mem.go:36] "Initialized new in-memory state store" May 25 07:35:54.613579 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.613568 2550 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 07:35:54.616444 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.616420 2550 kubelet.go:491] "Attempting to sync node with API server" May 25 07:35:54.616507 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.616457 2550 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 07:35:54.617181 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.617170 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 07:35:54.617234 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.617189 2550 kubelet.go:397] "Adding apiserver pod source" May 25 07:35:54.617234 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.617206 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 07:35:54.618478 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.618465 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 07:35:54.618554 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.618490 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 07:35:54.622398 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.622382 2550 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 07:35:54.623023 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.623006 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ts2rh" May 25 07:35:54.624966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.624944 2550 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 07:35:54.626298 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626257 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626305 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626334 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626351 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626363 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626373 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626382 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626390 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 07:35:54.626416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626419 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 07:35:54.626797 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626429 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 07:35:54.626797 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626458 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 07:35:54.626797 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626660 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 07:35:54.626797 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626698 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 07:35:54.626797 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.626706 2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 07:35:54.629575 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.629555 2550 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-15.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 07:35:54.629667 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.629591 2550 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 07:35:54.629667 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.629591 2550 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 07:35:54.630264 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.630246 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ts2rh" May 25 07:35:54.631687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.631673 2550 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 07:35:54.631964 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.631949 2550 server.go:1295] "Started kubelet" May 25 07:35:54.632263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.632221 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 07:35:54.632626 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.632585 2550 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 07:35:54.632708 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.632639 2550 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 07:35:54.632880 ip-10-0-133-15 systemd[1]: Started Kubernetes Kubelet. May 25 07:35:54.634036 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.634007 2550 server.go:317] "Adding debug handlers to kubelet server" May 25 07:35:54.634036 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.634019 2550 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 07:35:54.642521 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.642502 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 07:35:54.643236 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.643220 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 07:35:54.643420 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.643404 2550 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 07:35:54.643420 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.643420 2550 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 07:35:54.643548 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.643517 2550 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 07:35:54.643589 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.643568 2550 reconstruct.go:97] "Volume reconstruction finished" May 25 07:35:54.643589 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.643573 2550 reconciler.go:26] "Reconciler: start to sync state" May 25 07:35:54.644206 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.644115 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:54.646108 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646085 2550 factory.go:55] Registering systemd factory May 25 07:35:54.646195 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646137 2550 factory.go:223] Registration of the systemd container factory successfully May 25 07:35:54.646373 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646360 2550 factory.go:153] Registering CRI-O factory May 25 07:35:54.646437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646376 2550 factory.go:223] Registration of the crio container factory successfully May 25 07:35:54.646437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646429 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 07:35:54.646539 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646448 2550 factory.go:103] Registering Raw factory May 25 07:35:54.646539 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646464 2550 manager.go:1196] Started watching for new ooms in manager May 25 07:35:54.646640 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.646622 2550 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 07:35:54.646941 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646798 2550 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 07:35:54.647042 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.646847 2550 manager.go:319] Starting recovery of all containers May 25 07:35:54.650049 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.650028 2550 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-15.ec2.internal\" not found" node="ip-10-0-133-15.ec2.internal" May 25 07:35:54.655655 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.655640 2550 manager.go:324] Recovery completed May 25 07:35:54.662390 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.662371 2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 07:35:54.667472 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.667453 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientMemory" May 25 07:35:54.667567 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.667492 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasNoDiskPressure" May 25 07:35:54.667567 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.667507 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientPID" May 25 07:35:54.668071 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.668058 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 07:35:54.668164 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.668071 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 07:35:54.668164 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.668092 2550 state_mem.go:36] "Initialized new in-memory state store" May 25 07:35:54.672398 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.672384 2550 policy_none.go:49] "None policy: Start" May 25 07:35:54.672481 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.672404 2550 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 07:35:54.672481 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.672418 2550 state_mem.go:35] "Initializing new in-memory state store" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.709972 2550 manager.go:341] "Starting Device Plugin manager" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.710005 2550 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.710016 2550 server.go:85] "Starting device plugin registration server" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.710272 2550 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.710282 2550 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.710389 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.710476 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.710482 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.710998 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 07:35:54.725307 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.711032 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:54.740904 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.740874 2550 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 07:35:54.742162 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.742149 2550 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 07:35:54.742242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.742168 2550 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 07:35:54.742242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.742186 2550 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 07:35:54.742242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.742193 2550 kubelet.go:2451] "Starting kubelet main sync loop" May 25 07:35:54.742242 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.742235 2550 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 07:35:54.744985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.744968 2550 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 07:35:54.811231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.811149 2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 07:35:54.812290 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.812270 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientMemory" May 25 07:35:54.812386 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.812303 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasNoDiskPressure" May 25 07:35:54.812386 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.812336 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientPID" May 25 07:35:54.812386 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.812368 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-15.ec2.internal" May 25 07:35:54.824673 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.824646 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-15.ec2.internal" May 25 07:35:54.824754 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.824681 2550 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-15.ec2.internal\": node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:54.842008 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.841985 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:54.842885 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.842869 2550 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal"] May 25 07:35:54.842968 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.842959 2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 07:35:54.843962 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.843942 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientMemory" May 25 07:35:54.844043 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.843978 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasNoDiskPressure" May 25 07:35:54.844043 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.843989 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientPID" May 25 07:35:54.846369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.846354 2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 07:35:54.846488 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.846473 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:54.846542 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.846505 2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 07:35:54.847165 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.847148 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientMemory" May 25 07:35:54.847250 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.847174 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasNoDiskPressure" May 25 07:35:54.847250 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.847184 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientPID" May 25 07:35:54.847250 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.847148 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientMemory" May 25 07:35:54.847411 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.847262 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasNoDiskPressure" May 25 07:35:54.847411 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.847280 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientPID" May 25 07:35:54.849548 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.849530 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" May 25 07:35:54.849626 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.849566 2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 07:35:54.850267 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.850240 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientMemory" May 25 07:35:54.850267 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.850267 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasNoDiskPressure" May 25 07:35:54.850401 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.850281 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeHasSufficientPID" May 25 07:35:54.861836 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.861821 2550 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-15.ec2.internal\" not found" node="ip-10-0-133-15.ec2.internal" May 25 07:35:54.865005 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.864983 2550 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-15.ec2.internal\" not found" node="ip-10-0-133-15.ec2.internal" May 25 07:35:54.942569 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:54.942541 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:54.943761 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.943747 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7567034368dfe92b99e7f83ca79310bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal\" (UID: \"7567034368dfe92b99e7f83ca79310bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:54.943807 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:54.943770 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7567034368dfe92b99e7f83ca79310bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal\" (UID: \"7567034368dfe92b99e7f83ca79310bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:55.043393 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.043364 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.044515 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.044493 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7567034368dfe92b99e7f83ca79310bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal\" (UID: \"7567034368dfe92b99e7f83ca79310bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:55.044563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.044526 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7567034368dfe92b99e7f83ca79310bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal\" (UID: \"7567034368dfe92b99e7f83ca79310bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:55.044563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.044548 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ffef0a4855b3f685b4e4bc2683f975e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-15.ec2.internal\" (UID: \"8ffef0a4855b3f685b4e4bc2683f975e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" May 25 07:35:55.044620 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.044584 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7567034368dfe92b99e7f83ca79310bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal\" (UID: \"7567034368dfe92b99e7f83ca79310bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:55.044652 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.044634 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7567034368dfe92b99e7f83ca79310bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal\" (UID: \"7567034368dfe92b99e7f83ca79310bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:55.143945 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.143873 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.145020 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.144998 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ffef0a4855b3f685b4e4bc2683f975e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-15.ec2.internal\" (UID: \"8ffef0a4855b3f685b4e4bc2683f975e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" May 25 07:35:55.145063 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.145041 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ffef0a4855b3f685b4e4bc2683f975e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-15.ec2.internal\" (UID: \"8ffef0a4855b3f685b4e4bc2683f975e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" May 25 07:35:55.164153 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.164127 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:55.167921 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.167906 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" May 25 07:35:55.244504 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.244467 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.344860 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.344821 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.445254 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.445174 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.543523 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.543487 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 07:35:55.544134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.543646 2550 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 07:35:55.544134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.543661 2550 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 07:35:55.545601 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.545587 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.633194 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.633155 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 07:30:54 +0000 UTC" deadline="2028-02-19 18:08:25.538490044 +0000 UTC" May 25 07:35:55.633194 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.633190 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15250h32m29.90530412s" May 25 07:35:55.643084 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.643058 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 07:35:55.646276 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.646258 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.654532 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.654508 2550 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 07:35:55.678193 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.678167 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gx2gb" May 25 07:35:55.682685 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.682665 2550 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 07:35:55.685714 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.685697 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gx2gb" May 25 07:35:55.737357 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:55.735848 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffef0a4855b3f685b4e4bc2683f975e.slice/crio-aefc07179e8492077a894edc30ade3dacdbfffb4ff96a6b086efe1e02fb07e91 WatchSource:0}: Error finding container aefc07179e8492077a894edc30ade3dacdbfffb4ff96a6b086efe1e02fb07e91: Status 404 returned error can't find the container with id aefc07179e8492077a894edc30ade3dacdbfffb4ff96a6b086efe1e02fb07e91 May 25 07:35:55.737683 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:55.737663 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7567034368dfe92b99e7f83ca79310bb.slice/crio-aef2f43400d44b82a8c75ce95683dfd567a7e1b21d906caf21d8303250477a56 WatchSource:0}: Error finding container aef2f43400d44b82a8c75ce95683dfd567a7e1b21d906caf21d8303250477a56: Status 404 returned error can't find the container with id aef2f43400d44b82a8c75ce95683dfd567a7e1b21d906caf21d8303250477a56 May 25 07:35:55.739477 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.739460 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 07:35:55.744771 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.744735 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" event={"ID":"7567034368dfe92b99e7f83ca79310bb","Type":"ContainerStarted","Data":"aef2f43400d44b82a8c75ce95683dfd567a7e1b21d906caf21d8303250477a56"} May 25 07:35:55.745987 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:55.745958 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" event={"ID":"8ffef0a4855b3f685b4e4bc2683f975e","Type":"ContainerStarted","Data":"aefc07179e8492077a894edc30ade3dacdbfffb4ff96a6b086efe1e02fb07e91"} May 25 07:35:55.747082 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.747067 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.847443 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.847409 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:55.947805 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:55.947778 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:56.048230 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.048171 2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-15.ec2.internal\" not found" May 25 07:35:56.096211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.096184 2550 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 07:35:56.143583 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.143556 2550 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" May 25 07:35:56.155761 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.155733 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 07:35:56.156845 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.156825 2550 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" May 25 07:35:56.163922 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.163900 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 07:35:56.619008 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.618970 2550 apiserver.go:52] "Watching apiserver" May 25 07:35:56.629458 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.629434 2550 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 07:35:56.629873 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.629843 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zstfl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf","openshift-cluster-node-tuning-operator/tuned-w4slx","openshift-dns/node-resolver-bkh7r","openshift-image-registry/node-ca-bm9w7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal","openshift-multus/network-metrics-daemon-mbfkd","openshift-network-diagnostics/network-check-target-wx7vz","kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal","openshift-multus/multus-additional-cni-plugins-9bqcx","openshift-multus/multus-lp8s2","openshift-network-operator/iptables-alerter-ccrt2","openshift-ovn-kubernetes/ovnkube-node-ndgsk"] May 25 07:35:56.633167 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.633146 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:56.633247 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.633229 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:35:56.635355 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.635335 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.637524 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.637502 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.638280 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.638256 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 07:35:56.638380 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.638281 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 07:35:56.638380 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.638281 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 07:35:56.638921 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.638890 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7mx5j\"" May 25 07:35:56.640397 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.640380 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.641092 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.641052 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 07:35:56.641092 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.641076 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 07:35:56.641244 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.641157 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmnw6\"" May 25 07:35:56.642618 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.642601 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.643959 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.643677 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 07:35:56.643959 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.643784 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hm2pc\"" May 25 07:35:56.643959 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.643875 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 07:35:56.645075 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.645057 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.646272 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.646252 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 07:35:56.646407 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.646389 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kbq5b\"" May 25 07:35:56.647194 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.647174 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:56.647276 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.647243 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:35:56.648275 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.648256 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mk6wc\"" May 25 07:35:56.648385 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.648281 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 07:35:56.648385 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.648256 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 07:35:56.648881 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.648864 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 07:35:56.652114 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652075 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 07:35:56.652428 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652412 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-host\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.652473 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652444 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7k5t\" (UniqueName: \"kubernetes.io/projected/4ae74e4c-c815-4faa-a258-78e63338f423-kube-api-access-p7k5t\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.652528 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652478 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-socket-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.652528 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652512 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-device-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.652629 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652542 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnlzx\" (UniqueName: \"kubernetes.io/projected/f615663d-b120-444b-bdce-a84c2f3b26ef-kube-api-access-fnlzx\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.652629 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652572 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-systemd\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.652629 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652598 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ae74e4c-c815-4faa-a258-78e63338f423-etc-tuned\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.652764 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652664 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06-konnectivity-ca\") pod \"konnectivity-agent-zstfl\" (UID: \"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06\") " pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.652764 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652729 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-registration-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.652864 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652763 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.652864 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652842 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06-agent-certs\") pod \"konnectivity-agent-zstfl\" (UID: \"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06\") " pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.652959 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652880 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysconfig\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.652959 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652913 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-lib-modules\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.652959 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652954 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870e4d82-295f-4129-afea-b01aea6547c2-host\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.653097 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.652986 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:56.653097 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653066 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lp8s2" May 25 07:35:56.653186 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653078 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-run\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653186 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653172 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ae74e4c-c815-4faa-a258-78e63338f423-tmp\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653278 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653214 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70b158ef-eab0-42a1-abce-72214f1af1fa-hosts-file\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.653278 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653247 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70b158ef-eab0-42a1-abce-72214f1af1fa-tmp-dir\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.653410 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653290 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkxzv\" (UniqueName: \"kubernetes.io/projected/70b158ef-eab0-42a1-abce-72214f1af1fa-kube-api-access-jkxzv\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.653410 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653350 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-sys\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653410 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653389 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjpwz\" (UniqueName: \"kubernetes.io/projected/2bfb5b83-eb3f-499f-8643-cbe882eb483b-kube-api-access-zjpwz\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:56.653556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653437 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.653556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653469 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysctl-d\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653497 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysctl-conf\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653531 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/870e4d82-295f-4129-afea-b01aea6547c2-serviceca\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.653738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653573 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-sys-fs\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.653738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653611 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-modprobe-d\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653632 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.653738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653645 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6688\" (UniqueName: \"kubernetes.io/projected/870e4d82-295f-4129-afea-b01aea6547c2-kube-api-access-m6688\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.653929 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653748 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-kubernetes\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.653929 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.653782 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-var-lib-kubelet\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.655930 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.655912 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.658403 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.658380 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.665170 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665148 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665537 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665569 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kjp55\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665682 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665710 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665715 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665834 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 07:35:56.665947 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.665881 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.666703 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.666737 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.666744 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.666917 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.666951 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.667069 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.667191 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gsm7\"" May 25 07:35:56.667258 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.667237 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 07:35:56.667685 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.667238 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 07:35:56.667685 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.667297 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84ktv\"" May 25 07:35:56.667685 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.667482 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rd8zv\"" May 25 07:35:56.686705 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.686675 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 07:30:55 +0000 UTC" deadline="2027-10-20 15:26:59.339244747 +0000 UTC" May 25 07:35:56.686705 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.686704 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12319h51m2.652544553s" May 25 07:35:56.744990 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.744960 2550 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 07:35:56.754261 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754220 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-netns\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.754422 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754283 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7576b046-489a-4289-a2a7-fc6875aa6a6b-host-slash\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.754422 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754331 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-systemd-units\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.754522 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754420 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06-agent-certs\") pod \"konnectivity-agent-zstfl\" (UID: \"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06\") " pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.754522 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754465 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysconfig\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.754522 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754502 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-log-socket\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.754654 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754533 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-cni-bin\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.754654 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754568 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ae74e4c-c815-4faa-a258-78e63338f423-tmp\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.754654 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754617 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysconfig\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.754792 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754685 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvs6\" (UniqueName: \"kubernetes.io/projected/7576b046-489a-4289-a2a7-fc6875aa6a6b-kube-api-access-ftvs6\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.754792 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754726 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-etc-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.754792 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754765 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-cni-netd\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.754927 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754801 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-env-overrides\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.754927 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754865 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70b158ef-eab0-42a1-abce-72214f1af1fa-hosts-file\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.754927 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.754894 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70b158ef-eab0-42a1-abce-72214f1af1fa-tmp-dir\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.755116 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755095 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkxzv\" (UniqueName: \"kubernetes.io/projected/70b158ef-eab0-42a1-abce-72214f1af1fa-kube-api-access-jkxzv\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.755172 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755157 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.755223 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755125 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 07:35:56.755223 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755201 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-k8s-cni-cncf-io\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.755298 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755246 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-run-netns\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.755370 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755360 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjpwz\" (UniqueName: \"kubernetes.io/projected/2bfb5b83-eb3f-499f-8643-cbe882eb483b-kube-api-access-zjpwz\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:56.755431 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755409 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysctl-d\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.755738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755573 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70b158ef-eab0-42a1-abce-72214f1af1fa-tmp-dir\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.755738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755628 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysctl-d\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.755738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755173 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70b158ef-eab0-42a1-abce-72214f1af1fa-hosts-file\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.755738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755676 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-cni-binary-copy\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.755985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755739 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-cni-multus\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.755985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755786 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/870e4d82-295f-4129-afea-b01aea6547c2-serviceca\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.755985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755827 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-sys-fs\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.755985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755869 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-modprobe-d\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.755985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755926 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-var-lib-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.755985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755979 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6688\" (UniqueName: \"kubernetes.io/projected/870e4d82-295f-4129-afea-b01aea6547c2-kube-api-access-m6688\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.755966 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-sys-fs\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756020 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-kubernetes\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756049 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-var-lib-kubelet\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756072 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7k5t\" (UniqueName: \"kubernetes.io/projected/4ae74e4c-c815-4faa-a258-78e63338f423-kube-api-access-p7k5t\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756123 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-daemon-config\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756129 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-modprobe-d\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756153 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-slash\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756194 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756217 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.756243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756246 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-socket-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756305 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ae74e4c-c815-4faa-a258-78e63338f423-etc-tuned\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756373 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756393 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovn-node-metrics-cert\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756454 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/870e4d82-295f-4129-afea-b01aea6547c2-serviceca\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756532 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-var-lib-kubelet\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756615 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-kubernetes\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756631 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-socket-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756728 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756783 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06-konnectivity-ca\") pod \"konnectivity-agent-zstfl\" (UID: \"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06\") " pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756826 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756897 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-hostroot\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.757211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.756952 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757439 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-kubelet\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757487 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-node-log\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757480 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06-konnectivity-ca\") pod \"konnectivity-agent-zstfl\" (UID: \"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06\") " pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757541 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovnkube-script-lib\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757576 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfrg\" (UniqueName: \"kubernetes.io/projected/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-kube-api-access-hqfrg\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757620 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-lib-modules\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757682 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-cni-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.757731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757732 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-kubelet\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757725 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-lib-modules\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757783 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870e4d82-295f-4129-afea-b01aea6547c2-host\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757826 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757871 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-run\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757954 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-system-cni-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.757992 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-socket-dir-parent\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.758020 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:35:56.758072 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758027 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7576b046-489a-4289-a2a7-fc6875aa6a6b-iptables-alerter-script\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758087 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870e4d82-295f-4129-afea-b01aea6547c2-host\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.758137 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:35:57.258117266 +0000 UTC m=+3.118016884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758144 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-run\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758199 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-systemd\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758245 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-ovn\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758281 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-sys\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758363 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-system-cni-dir\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758399 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.758429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758427 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-os-release\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758459 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758525 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758535 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-sys\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758597 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysctl-conf\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758648 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-cni-bin\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758722 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-cnibin\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.758816 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758763 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rbxd\" (UniqueName: \"kubernetes.io/projected/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-kube-api-access-2rbxd\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758811 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovnkube-config\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758860 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-host\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758885 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-etc-kubernetes\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.758958 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-device-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759100 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnlzx\" (UniqueName: \"kubernetes.io/projected/f615663d-b120-444b-bdce-a84c2f3b26ef-kube-api-access-fnlzx\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759102 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-device-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759096 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-sysctl-conf\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759106 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-host\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.759166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759161 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-systemd\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759220 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759304 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759306 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ae74e4c-c815-4faa-a258-78e63338f423-etc-systemd\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759379 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-conf-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759416 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-multus-certs\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06-agent-certs\") pod \"konnectivity-agent-zstfl\" (UID: \"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06\") " pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759507 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-registration-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.759581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759558 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cnibin\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.759911 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759611 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f615663d-b120-444b-bdce-a84c2f3b26ef-registration-dir\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.759911 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759663 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-os-release\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.759911 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.759750 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgpkd\" (UniqueName: \"kubernetes.io/projected/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-kube-api-access-pgpkd\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.761800 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.761750 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ae74e4c-c815-4faa-a258-78e63338f423-tmp\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.762015 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.761990 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ae74e4c-c815-4faa-a258-78e63338f423-etc-tuned\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.765089 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.765065 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6688\" (UniqueName: \"kubernetes.io/projected/870e4d82-295f-4129-afea-b01aea6547c2-kube-api-access-m6688\") pod \"node-ca-bm9w7\" (UID: \"870e4d82-295f-4129-afea-b01aea6547c2\") " pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.765197 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.765091 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjpwz\" (UniqueName: \"kubernetes.io/projected/2bfb5b83-eb3f-499f-8643-cbe882eb483b-kube-api-access-zjpwz\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:56.765287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.765265 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkxzv\" (UniqueName: \"kubernetes.io/projected/70b158ef-eab0-42a1-abce-72214f1af1fa-kube-api-access-jkxzv\") pod \"node-resolver-bkh7r\" (UID: \"70b158ef-eab0-42a1-abce-72214f1af1fa\") " pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.765765 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.765745 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7k5t\" (UniqueName: \"kubernetes.io/projected/4ae74e4c-c815-4faa-a258-78e63338f423-kube-api-access-p7k5t\") pod \"tuned-w4slx\" (UID: \"4ae74e4c-c815-4faa-a258-78e63338f423\") " pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.771628 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.771611 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnlzx\" (UniqueName: \"kubernetes.io/projected/f615663d-b120-444b-bdce-a84c2f3b26ef-kube-api-access-fnlzx\") pod \"aws-ebs-csi-driver-node-ghzsf\" (UID: \"f615663d-b120-444b-bdce-a84c2f3b26ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.860075 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860034 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7576b046-489a-4289-a2a7-fc6875aa6a6b-host-slash\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860083 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-systemd-units\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860117 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-log-socket\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860138 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-cni-bin\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860158 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7576b046-489a-4289-a2a7-fc6875aa6a6b-host-slash\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860181 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-systemd-units\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860188 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-log-socket\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860178 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvs6\" (UniqueName: \"kubernetes.io/projected/7576b046-489a-4289-a2a7-fc6875aa6a6b-kube-api-access-ftvs6\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860232 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-cni-bin\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860248 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-etc-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860274 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-cni-netd\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860292 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-env-overrides\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860339 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860366 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-etc-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860371 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-k8s-cni-cncf-io\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860366 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-cni-netd\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860395 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-run-netns\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860424 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-k8s-cni-cncf-io\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860426 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-cni-binary-copy\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860467 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-cni-multus\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860496 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-run-netns\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860497 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-var-lib-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860543 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-daemon-config\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860547 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-cni-multus\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860566 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-slash\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860593 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.860706 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860622 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860680 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860708 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovn-node-metrics-cert\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860748 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860790 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-hostroot\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860815 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-kubelet\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860837 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-env-overrides\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860841 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-node-log\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860874 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-node-log\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860894 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovnkube-script-lib\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860918 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860922 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfrg\" (UniqueName: \"kubernetes.io/projected/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-kube-api-access-hqfrg\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860952 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-cni-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860965 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-cni-binary-copy\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860980 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-kubelet\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860989 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861005 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-slash\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.861501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861022 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-system-cni-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861060 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861070 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-socket-dir-parent\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861078 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-system-cni-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861098 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7576b046-489a-4289-a2a7-fc6875aa6a6b-iptables-alerter-script\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861123 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-systemd\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861150 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-ovn\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861181 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-system-cni-dir\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861209 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861236 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-os-release\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861241 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-hostroot\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861272 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-host-kubelet\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860924 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-var-lib-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861278 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-cni-bin\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861304 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-cnibin\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861336 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rbxd\" (UniqueName: \"kubernetes.io/projected/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-kube-api-access-2rbxd\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861345 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-socket-dir-parent\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861360 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovnkube-config\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861378 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-etc-kubernetes\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861395 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861412 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861437 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-conf-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861458 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-multus-certs\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861462 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-daemon-config\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861475 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cnibin\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.860966 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-openvswitch\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861530 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-cni-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861490 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-os-release\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861554 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-os-release\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861593 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-kubelet\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861597 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgpkd\" (UniqueName: \"kubernetes.io/projected/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-kube-api-access-pgpkd\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861623 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-cnibin\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861628 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-netns\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861637 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovnkube-script-lib\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861883 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7576b046-489a-4289-a2a7-fc6875aa6a6b-iptables-alerter-script\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.862806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861918 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-netns\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861929 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-system-cni-dir\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861965 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-systemd\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.861991 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-os-release\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862008 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-run-ovn\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862049 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-var-lib-cni-bin\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862072 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-etc-kubernetes\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862107 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovnkube-config\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862149 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-multus-conf-dir\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862176 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-host-run-multus-certs\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862202 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cnibin\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862218 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862360 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.862441 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.863268 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.863262 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-ovn-node-metrics-cert\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.867984 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.867966 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:35:56.867984 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.867985 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:35:56.868167 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.867994 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:35:56.868167 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:56.868047 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:35:57.368030289 +0000 UTC m=+3.227929890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:35:56.870507 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.870449 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvs6\" (UniqueName: \"kubernetes.io/projected/7576b046-489a-4289-a2a7-fc6875aa6a6b-kube-api-access-ftvs6\") pod \"iptables-alerter-ccrt2\" (UID: \"7576b046-489a-4289-a2a7-fc6875aa6a6b\") " pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:56.870853 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.870832 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rbxd\" (UniqueName: \"kubernetes.io/projected/87b484b6-7c8b-4d48-b21d-b5a1397a2e26-kube-api-access-2rbxd\") pod \"multus-lp8s2\" (UID: \"87b484b6-7c8b-4d48-b21d-b5a1397a2e26\") " pod="openshift-multus/multus-lp8s2" May 25 07:35:56.871259 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.871242 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfrg\" (UniqueName: \"kubernetes.io/projected/f84ff5cb-a4b9-4394-bf9d-cbdcf054c974-kube-api-access-hqfrg\") pod \"ovnkube-node-ndgsk\" (UID: \"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:56.871357 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.871267 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgpkd\" (UniqueName: \"kubernetes.io/projected/4c675f66-7c9b-44db-b7bf-675c5c4c6dbf-kube-api-access-pgpkd\") pod \"multus-additional-cni-plugins-9bqcx\" (UID: \"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf\") " pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.947675 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.947645 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" May 25 07:35:56.956566 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.956544 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4slx" May 25 07:35:56.966050 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.966030 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bkh7r" May 25 07:35:56.970577 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.970561 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bm9w7" May 25 07:35:56.978103 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.978084 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zstfl" May 25 07:35:56.984732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.984712 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lp8s2" May 25 07:35:56.991252 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.991232 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" May 25 07:35:56.998814 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:56.998795 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccrt2" May 25 07:35:57.004454 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.004435 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:35:57.092086 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.092057 2550 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 07:35:57.102057 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.102030 2550 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 07:35:57.264220 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.264122 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:57.264407 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.264301 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:35:57.264407 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.264400 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:35:58.264376622 +0000 UTC m=+4.124276224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:35:57.349655 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.349621 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e9ead9_8f13_40fc_8f1b_9b13f3e0dc06.slice/crio-c988f59da7a9c53fd274e20d5291f3bd75ce6024535b826955034d83de85b6db WatchSource:0}: Error finding container c988f59da7a9c53fd274e20d5291f3bd75ce6024535b826955034d83de85b6db: Status 404 returned error can't find the container with id c988f59da7a9c53fd274e20d5291f3bd75ce6024535b826955034d83de85b6db May 25 07:35:57.351399 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.351342 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae74e4c_c815_4faa_a258_78e63338f423.slice/crio-2a7340bbfd2e72fe78c53aa388edaf1b2117e2e9da1e3595334d7460d82b1ee2 WatchSource:0}: Error finding container 2a7340bbfd2e72fe78c53aa388edaf1b2117e2e9da1e3595334d7460d82b1ee2: Status 404 returned error can't find the container with id 2a7340bbfd2e72fe78c53aa388edaf1b2117e2e9da1e3595334d7460d82b1ee2 May 25 07:35:57.352138 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.352115 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7576b046_489a_4289_a2a7_fc6875aa6a6b.slice/crio-281add5724b777ccf087436ee603a5daef11ced1f7dd0bec20830768a51e2b6a WatchSource:0}: Error finding container 281add5724b777ccf087436ee603a5daef11ced1f7dd0bec20830768a51e2b6a: Status 404 returned error can't find the container with id 281add5724b777ccf087436ee603a5daef11ced1f7dd0bec20830768a51e2b6a May 25 07:35:57.354692 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.354667 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870e4d82_295f_4129_afea_b01aea6547c2.slice/crio-2d2943a45dc8caa0a11bf39495c78517d27a6dccfa43d16e6f97be05e59830f4 WatchSource:0}: Error finding container 2d2943a45dc8caa0a11bf39495c78517d27a6dccfa43d16e6f97be05e59830f4: Status 404 returned error can't find the container with id 2d2943a45dc8caa0a11bf39495c78517d27a6dccfa43d16e6f97be05e59830f4 May 25 07:35:57.355658 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.355632 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b158ef_eab0_42a1_abce_72214f1af1fa.slice/crio-51c6027eba611bc6bf3e5448ec1770c4dc8401c16aa976068fe71eea7df783b3 WatchSource:0}: Error finding container 51c6027eba611bc6bf3e5448ec1770c4dc8401c16aa976068fe71eea7df783b3: Status 404 returned error can't find the container with id 51c6027eba611bc6bf3e5448ec1770c4dc8401c16aa976068fe71eea7df783b3 May 25 07:35:57.356991 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.356961 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84ff5cb_a4b9_4394_bf9d_cbdcf054c974.slice/crio-e0d2a84ed850d2ea15ac066be0ba911307008266cbb5ef2182e7758b70d8d9d5 WatchSource:0}: Error finding container e0d2a84ed850d2ea15ac066be0ba911307008266cbb5ef2182e7758b70d8d9d5: Status 404 returned error can't find the container with id e0d2a84ed850d2ea15ac066be0ba911307008266cbb5ef2182e7758b70d8d9d5 May 25 07:35:57.357553 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.357496 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf615663d_b120_444b_bdce_a84c2f3b26ef.slice/crio-8963b5673a7931026711e928e8032c51384702527500e0a7b2032c18fb5e1115 WatchSource:0}: Error finding container 8963b5673a7931026711e928e8032c51384702527500e0a7b2032c18fb5e1115: Status 404 returned error can't find the container with id 8963b5673a7931026711e928e8032c51384702527500e0a7b2032c18fb5e1115 May 25 07:35:57.358983 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.358494 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b484b6_7c8b_4d48_b21d_b5a1397a2e26.slice/crio-adefd925f188120ad436a74cd05e02a3e7433c1d90f10930b8457d6aa79f206c WatchSource:0}: Error finding container adefd925f188120ad436a74cd05e02a3e7433c1d90f10930b8457d6aa79f206c: Status 404 returned error can't find the container with id adefd925f188120ad436a74cd05e02a3e7433c1d90f10930b8457d6aa79f206c May 25 07:35:57.360548 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:35:57.359814 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c675f66_7c9b_44db_b7bf_675c5c4c6dbf.slice/crio-99c5b0bbb660960e05e0c73015303f79a92850776e384f2de48b32bc6071876a WatchSource:0}: Error finding container 99c5b0bbb660960e05e0c73015303f79a92850776e384f2de48b32bc6071876a: Status 404 returned error can't find the container with id 99c5b0bbb660960e05e0c73015303f79a92850776e384f2de48b32bc6071876a May 25 07:35:57.465805 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.465608 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:57.465924 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.465749 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:35:57.465924 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.465886 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:35:57.465924 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.465899 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:35:57.466022 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.465949 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:35:58.465933387 +0000 UTC m=+4.325832989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:35:57.687391 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.687332 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 07:30:55 +0000 UTC" deadline="2028-01-27 06:51:50.126787077 +0000 UTC" May 25 07:35:57.687391 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.687366 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14687h15m52.43942434s" May 25 07:35:57.742804 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.742765 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:57.742976 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.742888 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:35:57.747857 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.743298 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:57.747857 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:57.743421 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:35:57.754681 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.754603 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lp8s2" event={"ID":"87b484b6-7c8b-4d48-b21d-b5a1397a2e26","Type":"ContainerStarted","Data":"adefd925f188120ad436a74cd05e02a3e7433c1d90f10930b8457d6aa79f206c"} May 25 07:35:57.759282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.759243 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" event={"ID":"f615663d-b120-444b-bdce-a84c2f3b26ef","Type":"ContainerStarted","Data":"8963b5673a7931026711e928e8032c51384702527500e0a7b2032c18fb5e1115"} May 25 07:35:57.760834 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.760800 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bkh7r" event={"ID":"70b158ef-eab0-42a1-abce-72214f1af1fa","Type":"ContainerStarted","Data":"51c6027eba611bc6bf3e5448ec1770c4dc8401c16aa976068fe71eea7df783b3"} May 25 07:35:57.762025 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.761989 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"e0d2a84ed850d2ea15ac066be0ba911307008266cbb5ef2182e7758b70d8d9d5"} May 25 07:35:57.770515 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.770455 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bm9w7" event={"ID":"870e4d82-295f-4129-afea-b01aea6547c2","Type":"ContainerStarted","Data":"2d2943a45dc8caa0a11bf39495c78517d27a6dccfa43d16e6f97be05e59830f4"} May 25 07:35:57.776857 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.776747 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccrt2" event={"ID":"7576b046-489a-4289-a2a7-fc6875aa6a6b","Type":"ContainerStarted","Data":"281add5724b777ccf087436ee603a5daef11ced1f7dd0bec20830768a51e2b6a"} May 25 07:35:57.782974 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.782863 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4slx" event={"ID":"4ae74e4c-c815-4faa-a258-78e63338f423","Type":"ContainerStarted","Data":"2a7340bbfd2e72fe78c53aa388edaf1b2117e2e9da1e3595334d7460d82b1ee2"} May 25 07:35:57.785791 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.785718 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zstfl" event={"ID":"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06","Type":"ContainerStarted","Data":"c988f59da7a9c53fd274e20d5291f3bd75ce6024535b826955034d83de85b6db"} May 25 07:35:57.793435 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.792595 2550 generic.go:358] "Generic (PLEG): container finished" podID="7567034368dfe92b99e7f83ca79310bb" containerID="7e63999598ba01c5a2362935be072aa62062334757f0b636d626bbe16135ef64" exitCode=0 May 25 07:35:57.793435 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.792666 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" event={"ID":"7567034368dfe92b99e7f83ca79310bb","Type":"ContainerDied","Data":"7e63999598ba01c5a2362935be072aa62062334757f0b636d626bbe16135ef64"} May 25 07:35:57.802654 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.802182 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" event={"ID":"8ffef0a4855b3f685b4e4bc2683f975e","Type":"ContainerStarted","Data":"7c74b7544fa9c48ffa08aea20d0cf42d27519c5079138ea386c00892287b501f"} May 25 07:35:57.811283 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.811206 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerStarted","Data":"99c5b0bbb660960e05e0c73015303f79a92850776e384f2de48b32bc6071876a"} May 25 07:35:57.823630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:57.823014 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-15.ec2.internal" podStartSLOduration=1.822999792 podStartE2EDuration="1.822999792s" podCreationTimestamp="2026-05-25 07:35:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 07:35:57.822028982 +0000 UTC m=+3.681928605" watchObservedRunningTime="2026-05-25 07:35:57.822999792 +0000 UTC m=+3.682899416" May 25 07:35:58.276106 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:58.275993 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:58.276106 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:58.276105 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:35:58.276341 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:58.276153 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:36:00.276140764 +0000 UTC m=+6.136040365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:35:58.480719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:58.480681 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:58.480886 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:58.480862 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:35:58.480886 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:58.480883 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:35:58.481008 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:58.480897 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:35:58.481008 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:58.480953 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:00.480935645 +0000 UTC m=+6.340835259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:35:58.825477 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:58.825424 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" event={"ID":"7567034368dfe92b99e7f83ca79310bb","Type":"ContainerStarted","Data":"49a4aba007f9ee14788266c3f2c7e364644829248c122863092c9bf83e9e3a94"} May 25 07:35:58.841562 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:58.841511 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-15.ec2.internal" podStartSLOduration=2.841493999 podStartE2EDuration="2.841493999s" podCreationTimestamp="2026-05-25 07:35:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 07:35:58.841372734 +0000 UTC m=+4.701272357" watchObservedRunningTime="2026-05-25 07:35:58.841493999 +0000 UTC m=+4.701393624" May 25 07:35:59.742754 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:59.742718 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:35:59.742950 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:35:59.742771 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:35:59.742950 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:59.742867 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:35:59.743479 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:35:59.743305 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:00.295388 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:00.294783 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:00.295388 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:00.294962 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:00.295388 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:00.295028 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:36:04.295008294 +0000 UTC m=+10.154907909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:00.496932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:00.496898 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:00.497116 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:00.497082 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:36:00.497116 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:00.497102 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:36:00.497116 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:00.497116 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:00.497267 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:00.497169 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:04.497155775 +0000 UTC m=+10.357055388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:01.743176 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:01.743141 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:01.743646 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:01.743273 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:01.743715 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:01.743683 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:01.743793 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:01.743773 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:03.742950 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:03.742913 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:03.743457 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:03.743102 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:03.743520 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:03.743503 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:03.743608 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:03.743587 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:04.331269 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.331227 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:04.331558 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.331408 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:04.331558 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.331476 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:36:12.331457236 +0000 UTC m=+18.191356844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:04.533697 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.533031 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:04.533697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.533212 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:36:04.533697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.533230 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:36:04.533697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.533245 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:04.533697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.533302 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:12.533284418 +0000 UTC m=+18.393184022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:04.659343 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.659250 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4q9cr"] May 25 07:36:04.666247 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.665774 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.666247 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.665859 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:04.734929 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.734892 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-dbus\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.735100 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.734953 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-kubelet-config\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.735100 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.735009 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.835440 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-kubelet-config\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.835525 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.835571 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-dbus\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.835732 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-dbus\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:04.835777 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-kubelet-config\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.835846 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 07:36:04.836111 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:04.835939 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret podName:ca5ca18c-ef79-4e09-84a7-4775571ce0d0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:05.335926322 +0000 UTC m=+11.195825927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret") pod "global-pull-secret-syncer-4q9cr" (UID: "ca5ca18c-ef79-4e09-84a7-4775571ce0d0") : object "kube-system"/"original-pull-secret" not registered May 25 07:36:05.340464 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:05.340424 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:05.340634 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:05.340574 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 07:36:05.340707 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:05.340646 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret podName:ca5ca18c-ef79-4e09-84a7-4775571ce0d0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:06.340627258 +0000 UTC m=+12.200526881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret") pod "global-pull-secret-syncer-4q9cr" (UID: "ca5ca18c-ef79-4e09-84a7-4775571ce0d0") : object "kube-system"/"original-pull-secret" not registered May 25 07:36:05.742714 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:05.742637 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:05.742869 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:05.742740 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:05.743169 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:05.743151 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:05.743258 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:05.743237 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:06.348871 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:06.348830 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:06.349331 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:06.348974 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 07:36:06.349331 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:06.349041 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret podName:ca5ca18c-ef79-4e09-84a7-4775571ce0d0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:08.349022608 +0000 UTC m=+14.208922218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret") pod "global-pull-secret-syncer-4q9cr" (UID: "ca5ca18c-ef79-4e09-84a7-4775571ce0d0") : object "kube-system"/"original-pull-secret" not registered May 25 07:36:06.742841 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:06.742757 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:06.743013 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:06.742882 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:07.743179 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:07.743094 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:07.743646 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:07.743095 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:07.743646 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:07.743227 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:07.743646 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:07.743351 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:08.362333 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:08.362283 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:08.362486 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:08.362446 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 07:36:08.362537 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:08.362517 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret podName:ca5ca18c-ef79-4e09-84a7-4775571ce0d0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:12.362495696 +0000 UTC m=+18.222395320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret") pod "global-pull-secret-syncer-4q9cr" (UID: "ca5ca18c-ef79-4e09-84a7-4775571ce0d0") : object "kube-system"/"original-pull-secret" not registered May 25 07:36:08.743613 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:08.743529 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:08.744042 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:08.743674 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:09.743081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:09.743048 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:09.743248 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:09.743186 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:09.743531 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:09.743048 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:09.743644 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:09.743617 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:10.742842 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:10.742804 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:10.743013 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:10.742952 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:11.742910 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:11.742870 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:11.743366 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:11.742866 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:11.743366 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:11.742997 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:11.743366 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:11.743092 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:12.391651 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:12.391613 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:12.391819 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:12.391660 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:12.391819 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.391733 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 07:36:12.391819 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.391765 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:12.391819 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.391804 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret podName:ca5ca18c-ef79-4e09-84a7-4775571ce0d0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:20.391784433 +0000 UTC m=+26.251684035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret") pod "global-pull-secret-syncer-4q9cr" (UID: "ca5ca18c-ef79-4e09-84a7-4775571ce0d0") : object "kube-system"/"original-pull-secret" not registered May 25 07:36:12.391819 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.391822 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:36:28.391813222 +0000 UTC m=+34.251712823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:12.593170 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:12.593126 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:12.593367 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.593235 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:36:12.593367 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.593261 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:36:12.593367 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.593276 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:12.593367 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.593355 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:28.593334578 +0000 UTC m=+34.453234179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:12.742534 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:12.742452 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:12.742697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:12.742589 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:13.742436 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:13.742406 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:13.742436 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:13.742417 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:13.742905 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:13.742514 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:13.742905 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:13.742635 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:14.743627 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:14.743594 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:14.744110 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:14.743718 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:15.742655 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.742595 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:15.742786 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:15.742707 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:15.742786 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.742716 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:15.742903 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:15.742812 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:15.858693 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.858601 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" event={"ID":"f615663d-b120-444b-bdce-a84c2f3b26ef","Type":"ContainerStarted","Data":"32aac8f788c094b09a6783d346fdff0b8c3907d56a3a139fbc31945caf2313aa"} May 25 07:36:15.861915 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.861882 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bkh7r" event={"ID":"70b158ef-eab0-42a1-abce-72214f1af1fa","Type":"ContainerStarted","Data":"3d530592b2e4ae0c3377575f7471b5066420d20009b88f1f5cd0379100e958e5"} May 25 07:36:15.863419 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.863397 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"23ea02992409e6c8d88eecbaaa7a157d66c6535f8c9f7787dfd4bffcd0b140ed"} May 25 07:36:15.864733 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.864709 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bm9w7" event={"ID":"870e4d82-295f-4129-afea-b01aea6547c2","Type":"ContainerStarted","Data":"963a1429199248b3a92910f193341f272bb74ac487b7f1539576e6f2f9836968"} May 25 07:36:15.866107 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.866078 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4slx" event={"ID":"4ae74e4c-c815-4faa-a258-78e63338f423","Type":"ContainerStarted","Data":"400bd418f57fd19e6ec903e0cd467ecd1788f6bc3b77d2a8895afc70d1fa7b01"} May 25 07:36:15.867435 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.867413 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zstfl" event={"ID":"94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06","Type":"ContainerStarted","Data":"1bb618e2e5326c72840a124cc58a0b48d98ba492f1e68050b10cf491f66977da"} May 25 07:36:15.868819 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.868798 2550 generic.go:358] "Generic (PLEG): container finished" podID="4c675f66-7c9b-44db-b7bf-675c5c4c6dbf" containerID="50b62f71a10c9542ed88083b7a3f19e6402cfd1cd8bdf44a9b3ee8a6827cc482" exitCode=0 May 25 07:36:15.868907 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.868865 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerDied","Data":"50b62f71a10c9542ed88083b7a3f19e6402cfd1cd8bdf44a9b3ee8a6827cc482"} May 25 07:36:15.870482 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.870374 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lp8s2" event={"ID":"87b484b6-7c8b-4d48-b21d-b5a1397a2e26","Type":"ContainerStarted","Data":"b89610260c01f6a402725f9c1b2fbffaed4fc2a6d394a337bb1da33ad97a8610"} May 25 07:36:15.877786 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.877746 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-bkh7r" podStartSLOduration=3.834009551 podStartE2EDuration="21.877733083s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.358038897 +0000 UTC m=+3.217938508" lastFinishedPulling="2026-05-25 07:36:15.401762424 +0000 UTC m=+21.261662040" observedRunningTime="2026-05-25 07:36:15.877660062 +0000 UTC m=+21.737559684" watchObservedRunningTime="2026-05-25 07:36:15.877733083 +0000 UTC m=+21.737632708" May 25 07:36:15.920196 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.920152 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-lp8s2" podStartSLOduration=3.8623738899999998 podStartE2EDuration="21.920136812s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.360908999 +0000 UTC m=+3.220808603" lastFinishedPulling="2026-05-25 07:36:15.418671924 +0000 UTC m=+21.278571525" observedRunningTime="2026-05-25 07:36:15.919689144 +0000 UTC m=+21.779588768" watchObservedRunningTime="2026-05-25 07:36:15.920136812 +0000 UTC m=+21.780036435" May 25 07:36:15.948210 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.948171 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4slx" podStartSLOduration=3.905827493 podStartE2EDuration="21.948155609s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.353776913 +0000 UTC m=+3.213676518" lastFinishedPulling="2026-05-25 07:36:15.396105033 +0000 UTC m=+21.256004634" observedRunningTime="2026-05-25 07:36:15.947848254 +0000 UTC m=+21.807747877" watchObservedRunningTime="2026-05-25 07:36:15.948155609 +0000 UTC m=+21.808055232" May 25 07:36:15.966253 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.966172 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bm9w7" podStartSLOduration=3.9593083030000003 podStartE2EDuration="21.966154121s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.356401191 +0000 UTC m=+3.216300796" lastFinishedPulling="2026-05-25 07:36:15.363247002 +0000 UTC m=+21.223146614" observedRunningTime="2026-05-25 07:36:15.96583881 +0000 UTC m=+21.825738434" watchObservedRunningTime="2026-05-25 07:36:15.966154121 +0000 UTC m=+21.826053744" May 25 07:36:15.983757 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:15.983715 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zstfl" podStartSLOduration=3.971812655 podStartE2EDuration="21.983699938s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.351286356 +0000 UTC m=+3.211185958" lastFinishedPulling="2026-05-25 07:36:15.363173613 +0000 UTC m=+21.223073241" observedRunningTime="2026-05-25 07:36:15.983254755 +0000 UTC m=+21.843154378" watchObservedRunningTime="2026-05-25 07:36:15.983699938 +0000 UTC m=+21.843599560" May 25 07:36:16.743638 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.743417 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:16.743826 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:16.743688 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:16.874284 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874259 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:36:16.874794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874545 2550 generic.go:358] "Generic (PLEG): container finished" podID="f84ff5cb-a4b9-4394-bf9d-cbdcf054c974" containerID="efcd6d2fedca661637f45cd39cf3054a15c6026d2af5eed39bf3d22d07477e50" exitCode=1 May 25 07:36:16.874794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874613 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"08e0cdd603a757c3ce9d4f518700816afe6f088b75e6f354384a77bc0a229961"} May 25 07:36:16.874794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874640 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"3760bc032e34d17d42a395fb658a31adb088a9705d6d5fd7bc93c0032520eaa6"} May 25 07:36:16.874794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874651 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"cb72b315cf9c7103ab29857ea481cdc8e52ad42211c793541ba3db3c262f8b97"} May 25 07:36:16.874794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874660 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"769b0817e6493aacf56c779680571cbda4f92572d632c773355307687d41b958"} May 25 07:36:16.874794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.874668 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerDied","Data":"efcd6d2fedca661637f45cd39cf3054a15c6026d2af5eed39bf3d22d07477e50"} May 25 07:36:16.875748 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.875695 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccrt2" event={"ID":"7576b046-489a-4289-a2a7-fc6875aa6a6b","Type":"ContainerStarted","Data":"d56f2aa494c60437ea4eb9a06d3310477018ad02f6080059a513bdc8bcf7daf5"} May 25 07:36:16.890484 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.890445 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ccrt2" podStartSLOduration=4.881393685 podStartE2EDuration="22.890433987s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.354131584 +0000 UTC m=+3.214031187" lastFinishedPulling="2026-05-25 07:36:15.363171877 +0000 UTC m=+21.223071489" observedRunningTime="2026-05-25 07:36:16.89010366 +0000 UTC m=+22.750003295" watchObservedRunningTime="2026-05-25 07:36:16.890433987 +0000 UTC m=+22.750333610" May 25 07:36:16.914042 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:16.914020 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 07:36:17.728422 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:17.727554 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T07:36:16.914036006Z","UUID":"127f3aa0-d221-4e6d-ad54-7e9fcf5622c5","Handler":null,"Name":"","Endpoint":""} May 25 07:36:17.729641 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:17.729591 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 07:36:17.729641 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:17.729625 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 07:36:17.743000 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:17.742976 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:17.743117 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:17.743073 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:17.743401 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:17.743385 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:17.743470 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:17.743452 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:17.879027 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:17.878990 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" event={"ID":"f615663d-b120-444b-bdce-a84c2f3b26ef","Type":"ContainerStarted","Data":"bf98a7d6cff447e4793125e8592f936156cc04a7872f1e93b6ab9fbef0adbb89"} May 25 07:36:18.743006 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.742971 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:18.743189 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:18.743096 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:18.758486 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.758459 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zstfl" May 25 07:36:18.759005 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.758987 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zstfl" May 25 07:36:18.883280 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.883239 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" event={"ID":"f615663d-b120-444b-bdce-a84c2f3b26ef","Type":"ContainerStarted","Data":"1ad2ddd7554beab9b4090e13565937013b0b75ed98cae638890a30e9b8f0f9f7"} May 25 07:36:18.886842 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.886815 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:36:18.887647 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.887620 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"f91c4e69e871c1989150c9f7e6bbe1f1a09172835485df3e61d6d7907161a323"} May 25 07:36:18.887796 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.887773 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zstfl" May 25 07:36:18.888303 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.888289 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zstfl" May 25 07:36:18.903144 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:18.903091 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghzsf" podStartSLOduration=4.108831118 podStartE2EDuration="24.903076751s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.359436353 +0000 UTC m=+3.219335958" lastFinishedPulling="2026-05-25 07:36:18.153681979 +0000 UTC m=+24.013581591" observedRunningTime="2026-05-25 07:36:18.90234403 +0000 UTC m=+24.762243651" watchObservedRunningTime="2026-05-25 07:36:18.903076751 +0000 UTC m=+24.762976373" May 25 07:36:19.742764 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:19.742546 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:19.743004 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:19.742546 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:19.743004 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:19.742875 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:19.743004 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:19.742939 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:20.448162 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.448130 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:20.448659 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:20.448264 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 07:36:20.448659 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:20.448350 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret podName:ca5ca18c-ef79-4e09-84a7-4775571ce0d0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:36.448329258 +0000 UTC m=+42.308228881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret") pod "global-pull-secret-syncer-4q9cr" (UID: "ca5ca18c-ef79-4e09-84a7-4775571ce0d0") : object "kube-system"/"original-pull-secret" not registered May 25 07:36:20.746561 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.746263 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:20.746561 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:20.746446 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:20.893937 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.893755 2550 generic.go:358] "Generic (PLEG): container finished" podID="4c675f66-7c9b-44db-b7bf-675c5c4c6dbf" containerID="f9202366f7f999105369616c80e058b9d823c256e1d084f3f2f25ed20b3ad76a" exitCode=0 May 25 07:36:20.894121 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.893840 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerDied","Data":"f9202366f7f999105369616c80e058b9d823c256e1d084f3f2f25ed20b3ad76a"} May 25 07:36:20.897126 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.897110 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:36:20.897493 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.897454 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"14703d46af095dbedfd60f1ce0943f5bed0e25fb6672567d73ca7529601efeff"} May 25 07:36:20.897818 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.897802 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:36:20.897898 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.897823 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:36:20.897993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.897978 2550 scope.go:117] "RemoveContainer" containerID="efcd6d2fedca661637f45cd39cf3054a15c6026d2af5eed39bf3d22d07477e50" May 25 07:36:20.914739 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:20.914719 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:36:21.742929 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.742898 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:21.743580 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.742904 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:21.743580 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:21.743007 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:21.743580 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:21.743109 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:21.902808 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.902724 2550 generic.go:358] "Generic (PLEG): container finished" podID="4c675f66-7c9b-44db-b7bf-675c5c4c6dbf" containerID="c51abe583ebce181b97651ea4af2eec7e3e74d93e43294104f8faa44fb8e7505" exitCode=0 May 25 07:36:21.902996 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.902822 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerDied","Data":"c51abe583ebce181b97651ea4af2eec7e3e74d93e43294104f8faa44fb8e7505"} May 25 07:36:21.907386 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.907361 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:36:21.907745 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.907721 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" event={"ID":"f84ff5cb-a4b9-4394-bf9d-cbdcf054c974","Type":"ContainerStarted","Data":"556ecd90648bd0c70080ace28ad189be16cf74e24463ada3522bab5eb6c45058"} May 25 07:36:21.908158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.908128 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:36:21.928982 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.928949 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:36:21.958891 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:21.958827 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" podStartSLOduration=9.637508232 podStartE2EDuration="27.958812862s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.359403844 +0000 UTC m=+3.219303445" lastFinishedPulling="2026-05-25 07:36:15.680708471 +0000 UTC m=+21.540608075" observedRunningTime="2026-05-25 07:36:21.957515913 +0000 UTC m=+27.817415535" watchObservedRunningTime="2026-05-25 07:36:21.958812862 +0000 UTC m=+27.818712485" May 25 07:36:22.605063 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.605035 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4q9cr"] May 25 07:36:22.605195 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.605155 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:22.605260 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:22.605242 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:22.612826 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.612798 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wx7vz"] May 25 07:36:22.612951 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.612929 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:22.613057 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:22.613036 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:22.613348 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.613308 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbfkd"] May 25 07:36:22.613440 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.613430 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:22.613534 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:22.613517 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:22.912171 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.912139 2550 generic.go:358] "Generic (PLEG): container finished" podID="4c675f66-7c9b-44db-b7bf-675c5c4c6dbf" containerID="5c503561e7724cb3d627ec3f3b30db6f8745b0ecbfe0e02da454ac540702c301" exitCode=0 May 25 07:36:22.912584 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:22.912221 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerDied","Data":"5c503561e7724cb3d627ec3f3b30db6f8745b0ecbfe0e02da454ac540702c301"} May 25 07:36:23.742945 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:23.742912 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:23.743132 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:23.743028 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:24.743756 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:24.743716 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:24.744145 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:24.743843 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:24.744145 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:24.743903 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:24.744145 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:24.744008 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:25.742656 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:25.742619 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:25.742812 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:25.742737 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:26.742939 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:26.742901 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:26.742939 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:26.742925 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:26.743424 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:26.743039 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:36:26.743424 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:26.743195 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q9cr" podUID="ca5ca18c-ef79-4e09-84a7-4775571ce0d0" May 25 07:36:27.742783 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:27.742744 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:27.743069 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:27.742887 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wx7vz" podUID="877e1dbf-190f-4d69-b159-72069b0c2965" May 25 07:36:28.406896 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.406800 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:28.407072 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.406987 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:28.407072 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.407070 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:37:00.407047956 +0000 UTC m=+66.266947561 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 07:36:28.470473 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.470441 2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-15.ec2.internal" event="NodeReady" May 25 07:36:28.470617 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.470589 2550 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 07:36:28.519242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.519210 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k6gm4"] May 25 07:36:28.549810 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.548953 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wqnbv"] May 25 07:36:28.570670 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.570643 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqnbv"] May 25 07:36:28.570670 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.570672 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k6gm4"] May 25 07:36:28.570890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.570777 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.570890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.570815 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:28.574688 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.574666 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 07:36:28.575838 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.575812 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 07:36:28.575998 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.575919 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9xn6x\"" May 25 07:36:28.576178 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.576144 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 07:36:28.602545 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.602522 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 07:36:28.602643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.602523 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qnmnv\"" May 25 07:36:28.602643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.602549 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 07:36:28.608504 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.608476 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:28.608599 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.608575 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 07:36:28.608599 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.608597 2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 07:36:28.608697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.608610 2550 projected.go:194] Error preparing data for projected volume kube-api-access-28b5s for pod openshift-network-diagnostics/network-check-target-wx7vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:28.608697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.608668 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s podName:877e1dbf-190f-4d69-b159-72069b0c2965 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:00.608649772 +0000 UTC m=+66.468549380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-28b5s" (UniqueName: "kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s") pod "network-check-target-wx7vz" (UID: "877e1dbf-190f-4d69-b159-72069b0c2965") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 07:36:28.709411 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.709374 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.709411 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.709415 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k77mz\" (UniqueName: \"kubernetes.io/projected/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-kube-api-access-k77mz\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:28.709630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.709445 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:28.709630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.709488 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvtf9\" (UniqueName: \"kubernetes.io/projected/35bafe66-39dd-4d27-b26a-1e932b8bda7a-kube-api-access-vvtf9\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.709630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.709511 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35bafe66-39dd-4d27-b26a-1e932b8bda7a-config-volume\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.709747 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.709640 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35bafe66-39dd-4d27-b26a-1e932b8bda7a-tmp-dir\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.743210 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.743171 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:36:28.743895 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.743382 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:28.746221 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.746196 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 07:36:28.746372 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.746208 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vllxs\"" May 25 07:36:28.746469 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.746209 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 07:36:28.810254 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810219 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.810254 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810256 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k77mz\" (UniqueName: \"kubernetes.io/projected/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-kube-api-access-k77mz\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:28.810476 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810296 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:28.810476 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810345 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvtf9\" (UniqueName: \"kubernetes.io/projected/35bafe66-39dd-4d27-b26a-1e932b8bda7a-kube-api-access-vvtf9\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.810476 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810377 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35bafe66-39dd-4d27-b26a-1e932b8bda7a-config-volume\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.810476 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.810392 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:36:28.810476 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810441 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35bafe66-39dd-4d27-b26a-1e932b8bda7a-tmp-dir\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.810476 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.810454 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:36:29.310435219 +0000 UTC m=+35.170334845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:36:28.810822 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.810491 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:36:28.810822 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:28.810547 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:29.310533177 +0000 UTC m=+35.170432781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:36:28.810822 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810755 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35bafe66-39dd-4d27-b26a-1e932b8bda7a-tmp-dir\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.810977 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.810962 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35bafe66-39dd-4d27-b26a-1e932b8bda7a-config-volume\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.821253 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.821231 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvtf9\" (UniqueName: \"kubernetes.io/projected/35bafe66-39dd-4d27-b26a-1e932b8bda7a-kube-api-access-vvtf9\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:28.821404 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:28.821327 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k77mz\" (UniqueName: \"kubernetes.io/projected/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-kube-api-access-k77mz\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:29.315241 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.315199 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:29.315455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.315255 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:29.315455 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:29.315367 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:36:29.315455 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:29.315373 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:36:29.315455 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:29.315435 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:30.315415116 +0000 UTC m=+36.175314731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:36:29.315455 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:29.315451 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:36:30.315443308 +0000 UTC m=+36.175342909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:36:29.743363 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.743340 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:36:29.745821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.745801 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 07:36:29.745911 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.745801 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zd29t\"" May 25 07:36:29.746887 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.746861 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 07:36:29.928385 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:29.928348 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerStarted","Data":"4e1f143932ec28fa9ac9a56bd671b539fd1c7b83ce0ffe63ae15c577b6958e0c"} May 25 07:36:30.322189 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:30.322102 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:30.322189 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:30.322183 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:30.322419 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:30.322246 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:36:30.322419 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:30.322258 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:36:30.322419 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:30.322331 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:32.322294031 +0000 UTC m=+38.182193632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:36:30.322419 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:30.322349 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:36:32.32234032 +0000 UTC m=+38.182239926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:36:30.932522 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:30.932486 2550 generic.go:358] "Generic (PLEG): container finished" podID="4c675f66-7c9b-44db-b7bf-675c5c4c6dbf" containerID="4e1f143932ec28fa9ac9a56bd671b539fd1c7b83ce0ffe63ae15c577b6958e0c" exitCode=0 May 25 07:36:30.932993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:30.932547 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerDied","Data":"4e1f143932ec28fa9ac9a56bd671b539fd1c7b83ce0ffe63ae15c577b6958e0c"} May 25 07:36:31.936663 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:31.936626 2550 generic.go:358] "Generic (PLEG): container finished" podID="4c675f66-7c9b-44db-b7bf-675c5c4c6dbf" containerID="99233a8e893ae3d26881b624a050f6e11a42a5dd96ff15c27638024642ef67a2" exitCode=0 May 25 07:36:31.937047 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:31.936696 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerDied","Data":"99233a8e893ae3d26881b624a050f6e11a42a5dd96ff15c27638024642ef67a2"} May 25 07:36:32.335846 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:32.335585 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:32.335846 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:32.335735 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:36:32.336049 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:32.335862 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:32.336049 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:32.335888 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:36.335873744 +0000 UTC m=+42.195773344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:36:32.336049 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:32.335947 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:36:32.336049 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:32.336001 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:36:36.335986572 +0000 UTC m=+42.195886174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:36:32.941871 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:32.941841 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" event={"ID":"4c675f66-7c9b-44db-b7bf-675c5c4c6dbf","Type":"ContainerStarted","Data":"b0b8c13e8cd759ede3b909def8cdafb42340bada2ec6a8e7b77d70fef4157e07"} May 25 07:36:32.980572 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:32.980523 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9bqcx" podStartSLOduration=6.611128335 podStartE2EDuration="38.980508934s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:35:57.36313656 +0000 UTC m=+3.223036193" lastFinishedPulling="2026-05-25 07:36:29.732517191 +0000 UTC m=+35.592416792" observedRunningTime="2026-05-25 07:36:32.97878968 +0000 UTC m=+38.838689303" watchObservedRunningTime="2026-05-25 07:36:32.980508934 +0000 UTC m=+38.840408556" May 25 07:36:36.368006 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.367968 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:36.368481 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.368055 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:36.368481 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:36.368140 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:36:36.368481 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:36.368214 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:36:44.368198472 +0000 UTC m=+50.228098073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:36:36.368481 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:36.368145 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:36:36.368481 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:36.368272 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:36:44.368259424 +0000 UTC m=+50.228159025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:36:36.468646 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.468604 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:36.471841 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.471808 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca5ca18c-ef79-4e09-84a7-4775571ce0d0-original-pull-secret\") pod \"global-pull-secret-syncer-4q9cr\" (UID: \"ca5ca18c-ef79-4e09-84a7-4775571ce0d0\") " pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:36.561541 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.561515 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q9cr" May 25 07:36:36.763227 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.763179 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4q9cr"] May 25 07:36:36.767086 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:36:36.767057 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5ca18c_ef79_4e09_84a7_4775571ce0d0.slice/crio-510ba9bab6e184634df736c5f432b06b063ff5a9df6c744c0b5733729fb7fdef WatchSource:0}: Error finding container 510ba9bab6e184634df736c5f432b06b063ff5a9df6c744c0b5733729fb7fdef: Status 404 returned error can't find the container with id 510ba9bab6e184634df736c5f432b06b063ff5a9df6c744c0b5733729fb7fdef May 25 07:36:36.951102 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:36.951070 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4q9cr" event={"ID":"ca5ca18c-ef79-4e09-84a7-4775571ce0d0","Type":"ContainerStarted","Data":"510ba9bab6e184634df736c5f432b06b063ff5a9df6c744c0b5733729fb7fdef"} May 25 07:36:40.960572 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:40.960537 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4q9cr" event={"ID":"ca5ca18c-ef79-4e09-84a7-4775571ce0d0","Type":"ContainerStarted","Data":"b2d7c4d25670b0d9bf2eded1ac7ebad28a465214e699858c8df7656c102a15d7"} May 25 07:36:40.975632 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:40.975591 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4q9cr" podStartSLOduration=33.080078715 podStartE2EDuration="36.975576751s" podCreationTimestamp="2026-05-25 07:36:04 +0000 UTC" firstStartedPulling="2026-05-25 07:36:36.768857753 +0000 UTC m=+42.628757355" lastFinishedPulling="2026-05-25 07:36:40.66435579 +0000 UTC m=+46.524255391" observedRunningTime="2026-05-25 07:36:40.975063161 +0000 UTC m=+46.834962786" watchObservedRunningTime="2026-05-25 07:36:40.975576751 +0000 UTC m=+46.835476373" May 25 07:36:44.426914 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:44.426865 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:36:44.427420 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:44.426929 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:36:44.427420 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:44.427023 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:36:44.427420 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:44.427023 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:36:44.427420 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:44.427093 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:37:00.427074338 +0000 UTC m=+66.286973938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:36:44.427420 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:36:44.427107 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:00.42710148 +0000 UTC m=+66.287001082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:36:53.925267 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:36:53.925232 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndgsk" May 25 07:37:00.436016 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.435975 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:37:00.436016 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.436023 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:37:00.436533 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.436050 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:37:00.436533 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:00.436146 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:37:00.436533 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:00.436174 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:37:00.436533 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:00.436209 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:32.43619224 +0000 UTC m=+98.296091842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:37:00.436533 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:00.436248 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:37:32.436233513 +0000 UTC m=+98.296133114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:37:00.439168 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.439151 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 07:37:00.446489 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:00.446466 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 07:37:00.446582 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:00.446542 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:38:04.446522508 +0000 UTC m=+130.306422111 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : secret "metrics-daemon-secret" not found May 25 07:37:00.637708 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.637673 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:37:00.640834 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.640815 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 07:37:00.651389 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.651370 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 07:37:00.660668 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.660639 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28b5s\" (UniqueName: \"kubernetes.io/projected/877e1dbf-190f-4d69-b159-72069b0c2965-kube-api-access-28b5s\") pod \"network-check-target-wx7vz\" (UID: \"877e1dbf-190f-4d69-b159-72069b0c2965\") " pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:37:00.955085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.955058 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zd29t\"" May 25 07:37:00.963281 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:00.963261 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:37:01.116226 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:01.116199 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wx7vz"] May 25 07:37:01.117639 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:37:01.117611 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877e1dbf_190f_4d69_b159_72069b0c2965.slice/crio-ff3e253f91af4aaa8e391cf49efea15bd95ad3d9d8b4710c808ddaa7da3c7fe7 WatchSource:0}: Error finding container ff3e253f91af4aaa8e391cf49efea15bd95ad3d9d8b4710c808ddaa7da3c7fe7: Status 404 returned error can't find the container with id ff3e253f91af4aaa8e391cf49efea15bd95ad3d9d8b4710c808ddaa7da3c7fe7 May 25 07:37:02.001785 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:02.001745 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wx7vz" event={"ID":"877e1dbf-190f-4d69-b159-72069b0c2965","Type":"ContainerStarted","Data":"ff3e253f91af4aaa8e391cf49efea15bd95ad3d9d8b4710c808ddaa7da3c7fe7"} May 25 07:37:05.008854 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:05.008813 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wx7vz" event={"ID":"877e1dbf-190f-4d69-b159-72069b0c2965","Type":"ContainerStarted","Data":"8dc34e70ebed038aa602296c14b738bee9d6e23570f0fbe3c4eecc4f48069f38"} May 25 07:37:05.009281 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:05.008939 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:37:05.040026 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:05.039982 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wx7vz" podStartSLOduration=67.939868504 podStartE2EDuration="1m11.039970072s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:37:01.119359917 +0000 UTC m=+66.979259519" lastFinishedPulling="2026-05-25 07:37:04.219461484 +0000 UTC m=+70.079361087" observedRunningTime="2026-05-25 07:37:05.039517511 +0000 UTC m=+70.899417134" watchObservedRunningTime="2026-05-25 07:37:05.039970072 +0000 UTC m=+70.899869689" May 25 07:37:32.456525 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:32.456486 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:37:32.456525 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:32.456533 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:37:32.457054 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:32.456631 2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 07:37:32.457054 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:32.456665 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 07:37:32.457054 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:32.456690 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert podName:5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:36.456675962 +0000 UTC m=+162.316575563 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert") pod "ingress-canary-wqnbv" (UID: "5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0") : secret "canary-serving-cert" not found May 25 07:37:32.457054 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:32.456739 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls podName:35bafe66-39dd-4d27-b26a-1e932b8bda7a nodeName:}" failed. No retries permitted until 2026-05-25 07:38:36.456722131 +0000 UTC m=+162.316621732 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls") pod "dns-default-k6gm4" (UID: "35bafe66-39dd-4d27-b26a-1e932b8bda7a") : secret "dns-default-metrics-tls" not found May 25 07:37:36.013256 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:36.013225 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wx7vz" May 25 07:37:53.734584 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.734535 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55f99b4774-qfczw"] May 25 07:37:53.738659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.738641 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.743929 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.743907 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 25 07:37:53.744118 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.744100 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 25 07:37:53.744186 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.744145 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 25 07:37:53.744242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.744145 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 25 07:37:53.744821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.744474 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s2kct\"" May 25 07:37:53.744821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.744505 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 25 07:37:53.745410 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.745396 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 25 07:37:53.759515 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.759490 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55f99b4774-qfczw"] May 25 07:37:53.800141 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.800112 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.800287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.800145 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvjr4\" (UniqueName: \"kubernetes.io/projected/d2e4cd46-7c1f-4356-ae55-9932adfd6881-kube-api-access-qvjr4\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.800287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.800216 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.800287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.800245 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-stats-auth\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.800436 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.800291 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-default-certificate\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.901497 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.901461 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvjr4\" (UniqueName: \"kubernetes.io/projected/d2e4cd46-7c1f-4356-ae55-9932adfd6881-kube-api-access-qvjr4\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.901652 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.901524 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.901652 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.901553 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-stats-auth\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.901652 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.901582 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-default-certificate\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.901652 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.901604 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.901799 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:53.901684 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 07:37:53.901799 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:53.901740 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:54.401719627 +0000 UTC m=+120.261619229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : configmap references non-existent config key: service-ca.crt May 25 07:37:53.901799 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:53.901767 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:54.40175637 +0000 UTC m=+120.261655970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : secret "router-metrics-certs-default" not found May 25 07:37:53.904223 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.904202 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-stats-auth\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.904359 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.904241 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-default-certificate\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:53.914736 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:53.914715 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvjr4\" (UniqueName: \"kubernetes.io/projected/d2e4cd46-7c1f-4356-ae55-9932adfd6881-kube-api-access-qvjr4\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:54.405549 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:54.405502 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:54.405728 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:54.405569 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:54.405728 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:54.405660 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 07:37:54.405728 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:54.405697 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:55.405680018 +0000 UTC m=+121.265579618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : configmap references non-existent config key: service-ca.crt May 25 07:37:54.405847 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:54.405731 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:55.405716524 +0000 UTC m=+121.265616125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : secret "router-metrics-certs-default" not found May 25 07:37:55.413563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:55.413527 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:55.413957 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:55.413586 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:55.413957 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:55.413686 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 07:37:55.413957 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:55.413716 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:57.413701194 +0000 UTC m=+123.273600796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : configmap references non-existent config key: service-ca.crt May 25 07:37:55.413957 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:55.413739 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:57.413725389 +0000 UTC m=+123.273624991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : secret "router-metrics-certs-default" not found May 25 07:37:56.736601 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.736567 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7"] May 25 07:37:56.739651 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.739635 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:56.742415 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.742393 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 25 07:37:56.743164 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.743142 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n4rrj\"" May 25 07:37:56.743281 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.743165 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 25 07:37:56.743434 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.743419 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 25 07:37:56.778324 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.778281 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7"] May 25 07:37:56.823950 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.823922 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zh2r\" (UniqueName: \"kubernetes.io/projected/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-kube-api-access-8zh2r\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:56.824084 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.823973 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:56.925223 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.925178 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:56.925351 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.925285 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zh2r\" (UniqueName: \"kubernetes.io/projected/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-kube-api-access-8zh2r\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:56.925351 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:56.925337 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 07:37:56.925424 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:56.925400 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls podName:3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:57.425383899 +0000 UTC m=+123.285283500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls") pod "cluster-samples-operator-697587599-r4bw7" (UID: "3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8") : secret "samples-operator-tls" not found May 25 07:37:56.946064 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:56.946034 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zh2r\" (UniqueName: \"kubernetes.io/projected/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-kube-api-access-8zh2r\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:57.428720 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:57.428688 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:57.428720 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:57.428721 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:57.428920 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:57.428759 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:37:57.428920 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:57.428832 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 07:37:57.428920 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:57.428835 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 07:37:57.428920 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:57.428871 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:01.428852874 +0000 UTC m=+127.288752478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : configmap references non-existent config key: service-ca.crt May 25 07:37:57.428920 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:57.428887 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:01.42888012 +0000 UTC m=+127.288779721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : secret "router-metrics-certs-default" not found May 25 07:37:57.428920 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:57.428897 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls podName:3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8 nodeName:}" failed. No retries permitted until 2026-05-25 07:37:58.428891818 +0000 UTC m=+124.288791419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls") pod "cluster-samples-operator-697587599-r4bw7" (UID: "3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8") : secret "samples-operator-tls" not found May 25 07:37:58.437097 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:37:58.437060 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:37:58.437515 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:58.437163 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 07:37:58.437515 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:37:58.437219 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls podName:3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:00.437204844 +0000 UTC m=+126.297104445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls") pod "cluster-samples-operator-697587599-r4bw7" (UID: "3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8") : secret "samples-operator-tls" not found May 25 07:38:00.453655 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:00.453616 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:38:00.454217 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:00.453794 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 07:38:00.454217 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:00.453901 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls podName:3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:04.453877273 +0000 UTC m=+130.313776875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls") pod "cluster-samples-operator-697587599-r4bw7" (UID: "3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8") : secret "samples-operator-tls" not found May 25 07:38:01.462196 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.462159 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:01.462617 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.462223 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:01.462617 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:01.462331 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 07:38:01.462617 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:01.462337 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:09.462305283 +0000 UTC m=+135.322204884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : configmap references non-existent config key: service-ca.crt May 25 07:38:01.462617 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:01.462398 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:09.462383908 +0000 UTC m=+135.322283508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : secret "router-metrics-certs-default" not found May 25 07:38:01.638542 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.638503 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9"] May 25 07:38:01.641246 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.641231 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.647881 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.647429 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 25 07:38:01.647881 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.647588 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ccz89\"" May 25 07:38:01.648134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.648111 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 25 07:38:01.648264 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.648227 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 25 07:38:01.648386 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.648366 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 25 07:38:01.666344 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.666298 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9"] May 25 07:38:01.764490 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.764402 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c67a9311-7d6d-424a-a104-dfd75b2cada8-config\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.764490 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.764480 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c67a9311-7d6d-424a-a104-dfd75b2cada8-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.764669 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.764516 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49n7w\" (UniqueName: \"kubernetes.io/projected/c67a9311-7d6d-424a-a104-dfd75b2cada8-kube-api-access-49n7w\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.865081 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.865043 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c67a9311-7d6d-424a-a104-dfd75b2cada8-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.865280 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.865100 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49n7w\" (UniqueName: \"kubernetes.io/projected/c67a9311-7d6d-424a-a104-dfd75b2cada8-kube-api-access-49n7w\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.865280 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.865144 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c67a9311-7d6d-424a-a104-dfd75b2cada8-config\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.865632 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.865612 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c67a9311-7d6d-424a-a104-dfd75b2cada8-config\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.867547 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.867525 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c67a9311-7d6d-424a-a104-dfd75b2cada8-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.881044 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.881015 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49n7w\" (UniqueName: \"kubernetes.io/projected/c67a9311-7d6d-424a-a104-dfd75b2cada8-kube-api-access-49n7w\") pod \"kube-storage-version-migrator-operator-565644f49-kdbz9\" (UID: \"c67a9311-7d6d-424a-a104-dfd75b2cada8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:01.951884 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:01.951843 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" May 25 07:38:02.093190 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:02.093156 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9"] May 25 07:38:02.096669 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:02.096631 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67a9311_7d6d_424a_a104_dfd75b2cada8.slice/crio-672244ac41e79cc1297021a49acbf19256c2a6321b6cff9623c0b4949a8ff951 WatchSource:0}: Error finding container 672244ac41e79cc1297021a49acbf19256c2a6321b6cff9623c0b4949a8ff951: Status 404 returned error can't find the container with id 672244ac41e79cc1297021a49acbf19256c2a6321b6cff9623c0b4949a8ff951 May 25 07:38:02.116690 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:02.116659 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" event={"ID":"c67a9311-7d6d-424a-a104-dfd75b2cada8","Type":"ContainerStarted","Data":"672244ac41e79cc1297021a49acbf19256c2a6321b6cff9623c0b4949a8ff951"} May 25 07:38:02.532183 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:02.532156 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bkh7r_70b158ef-eab0-42a1-abce-72214f1af1fa/dns-node-resolver/0.log" May 25 07:38:03.526960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.526937 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bm9w7_870e4d82-295f-4129-afea-b01aea6547c2/node-ca/0.log" May 25 07:38:03.666265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.666228 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd"] May 25 07:38:03.669023 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.669007 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.675698 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.675677 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 25 07:38:03.675785 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.675727 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bj7n4\"" May 25 07:38:03.676456 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.676437 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 25 07:38:03.680369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.680352 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 25 07:38:03.680710 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.680697 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 25 07:38:03.697247 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.697220 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd"] May 25 07:38:03.780960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.780865 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwgsm\" (UniqueName: \"kubernetes.io/projected/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-kube-api-access-mwgsm\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.780960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.780921 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-config\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.781142 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.781000 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-serving-cert\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.881423 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.881393 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwgsm\" (UniqueName: \"kubernetes.io/projected/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-kube-api-access-mwgsm\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.881519 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.881445 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-config\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.881519 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.881497 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-serving-cert\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.881985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.881954 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-config\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.883830 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.883809 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-serving-cert\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.891085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.891067 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwgsm\" (UniqueName: \"kubernetes.io/projected/10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e-kube-api-access-mwgsm\") pod \"service-ca-operator-57b5b68b8-td2cd\" (UID: \"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:03.977686 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:03.977648 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" May 25 07:38:04.120765 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.120731 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd"] May 25 07:38:04.124733 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:04.124696 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f9ee2c_6668_4ee2_9cae_bb2edd41ef3e.slice/crio-06eb818ec67227cc01ec6f72cbeb85de866876572b729a46c0edc8ae6aa4e83b WatchSource:0}: Error finding container 06eb818ec67227cc01ec6f72cbeb85de866876572b729a46c0edc8ae6aa4e83b: Status 404 returned error can't find the container with id 06eb818ec67227cc01ec6f72cbeb85de866876572b729a46c0edc8ae6aa4e83b May 25 07:38:04.451148 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.451112 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6"] May 25 07:38:04.454410 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.454377 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" May 25 07:38:04.460246 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.460216 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4kwr2\"" May 25 07:38:04.482699 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.482663 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6"] May 25 07:38:04.485957 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.485928 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:38:04.486097 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.486002 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:38:04.486157 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:04.486115 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 07:38:04.486216 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:04.486204 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls podName:3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:12.486180787 +0000 UTC m=+138.346080411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls") pod "cluster-samples-operator-697587599-r4bw7" (UID: "3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8") : secret "samples-operator-tls" not found May 25 07:38:04.486751 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:04.486115 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 07:38:04.486828 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:04.486797 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs podName:2bfb5b83-eb3f-499f-8643-cbe882eb483b nodeName:}" failed. No retries permitted until 2026-05-25 07:40:06.486780742 +0000 UTC m=+252.346680359 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs") pod "network-metrics-daemon-mbfkd" (UID: "2bfb5b83-eb3f-499f-8643-cbe882eb483b") : secret "metrics-daemon-secret" not found May 25 07:38:04.586836 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.586801 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5654\" (UniqueName: \"kubernetes.io/projected/50650525-a26f-4fde-b1c5-f6ede19508d9-kube-api-access-s5654\") pod \"network-check-source-7f44b6dd87-lszj6\" (UID: \"50650525-a26f-4fde-b1c5-f6ede19508d9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" May 25 07:38:04.687460 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.687420 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5654\" (UniqueName: \"kubernetes.io/projected/50650525-a26f-4fde-b1c5-f6ede19508d9-kube-api-access-s5654\") pod \"network-check-source-7f44b6dd87-lszj6\" (UID: \"50650525-a26f-4fde-b1c5-f6ede19508d9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" May 25 07:38:04.699214 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.699185 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5654\" (UniqueName: \"kubernetes.io/projected/50650525-a26f-4fde-b1c5-f6ede19508d9-kube-api-access-s5654\") pod \"network-check-source-7f44b6dd87-lszj6\" (UID: \"50650525-a26f-4fde-b1c5-f6ede19508d9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" May 25 07:38:04.764236 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.764147 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" May 25 07:38:04.979694 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:04.979661 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6"] May 25 07:38:04.982827 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:04.982795 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50650525_a26f_4fde_b1c5_f6ede19508d9.slice/crio-295f1689b163b5733cffab6431e7b081841e875f9d3459bdd29990e948b6c691 WatchSource:0}: Error finding container 295f1689b163b5733cffab6431e7b081841e875f9d3459bdd29990e948b6c691: Status 404 returned error can't find the container with id 295f1689b163b5733cffab6431e7b081841e875f9d3459bdd29990e948b6c691 May 25 07:38:05.124503 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:05.124465 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" event={"ID":"50650525-a26f-4fde-b1c5-f6ede19508d9","Type":"ContainerStarted","Data":"1613b139d67612b8cffe08c65b76100edef3451ec49591d7138335e7cb472f6e"} May 25 07:38:05.124673 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:05.124514 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" event={"ID":"50650525-a26f-4fde-b1c5-f6ede19508d9","Type":"ContainerStarted","Data":"295f1689b163b5733cffab6431e7b081841e875f9d3459bdd29990e948b6c691"} May 25 07:38:05.125844 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:05.125813 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" event={"ID":"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e","Type":"ContainerStarted","Data":"06eb818ec67227cc01ec6f72cbeb85de866876572b729a46c0edc8ae6aa4e83b"} May 25 07:38:05.127204 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:05.127168 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" event={"ID":"c67a9311-7d6d-424a-a104-dfd75b2cada8","Type":"ContainerStarted","Data":"b549e3555e6fa5b2a151ebea3464911e0dda71404e0241d63c62d3c4aa8848fe"} May 25 07:38:05.156547 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:05.156480 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lszj6" podStartSLOduration=1.156462218 podStartE2EDuration="1.156462218s" podCreationTimestamp="2026-05-25 07:38:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 07:38:05.154787101 +0000 UTC m=+131.014686726" watchObservedRunningTime="2026-05-25 07:38:05.156462218 +0000 UTC m=+131.016361842" May 25 07:38:05.214962 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:05.214915 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" podStartSLOduration=1.42345931 podStartE2EDuration="4.214899506s" podCreationTimestamp="2026-05-25 07:38:01 +0000 UTC" firstStartedPulling="2026-05-25 07:38:02.098422954 +0000 UTC m=+127.958322554" lastFinishedPulling="2026-05-25 07:38:04.889863149 +0000 UTC m=+130.749762750" observedRunningTime="2026-05-25 07:38:05.212649197 +0000 UTC m=+131.072548820" watchObservedRunningTime="2026-05-25 07:38:05.214899506 +0000 UTC m=+131.074799128" May 25 07:38:07.132765 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:07.132735 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" event={"ID":"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e","Type":"ContainerStarted","Data":"a1614179153dfc0d387c54165688197fdd0562b12da5b6ea47d91f663ee3198b"} May 25 07:38:07.225276 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:07.225223 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" podStartSLOduration=1.349660482 podStartE2EDuration="4.225207046s" podCreationTimestamp="2026-05-25 07:38:03 +0000 UTC" firstStartedPulling="2026-05-25 07:38:04.126605563 +0000 UTC m=+129.986505164" lastFinishedPulling="2026-05-25 07:38:07.002152122 +0000 UTC m=+132.862051728" observedRunningTime="2026-05-25 07:38:07.224215094 +0000 UTC m=+133.084114720" watchObservedRunningTime="2026-05-25 07:38:07.225207046 +0000 UTC m=+133.085106706" May 25 07:38:09.527796 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:09.527745 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:09.528189 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:09.527837 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:09.528189 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:09.527911 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:25.527890968 +0000 UTC m=+151.387790569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : configmap references non-existent config key: service-ca.crt May 25 07:38:09.528189 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:09.527930 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 07:38:09.528189 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:09.527971 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs podName:d2e4cd46-7c1f-4356-ae55-9932adfd6881 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:25.527957809 +0000 UTC m=+151.387857409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs") pod "router-default-55f99b4774-qfczw" (UID: "d2e4cd46-7c1f-4356-ae55-9932adfd6881") : secret "router-metrics-certs-default" not found May 25 07:38:11.550795 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.550763 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-565lp"] May 25 07:38:11.553904 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.553888 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.563037 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.563018 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 25 07:38:11.563121 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.563065 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 25 07:38:11.563896 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.563880 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 25 07:38:11.563977 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.563961 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 25 07:38:11.564009 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.563967 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kdd7v\"" May 25 07:38:11.572420 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.572400 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-565lp"] May 25 07:38:11.643717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.643690 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zgxd\" (UniqueName: \"kubernetes.io/projected/31c3ff62-86c7-44c0-b2a5-890105837055-kube-api-access-9zgxd\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.643902 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.643763 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/31c3ff62-86c7-44c0-b2a5-890105837055-signing-key\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.643902 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.643780 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/31c3ff62-86c7-44c0-b2a5-890105837055-signing-cabundle\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.744539 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.744501 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zgxd\" (UniqueName: \"kubernetes.io/projected/31c3ff62-86c7-44c0-b2a5-890105837055-kube-api-access-9zgxd\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.744722 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.744597 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/31c3ff62-86c7-44c0-b2a5-890105837055-signing-key\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.744722 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.744624 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/31c3ff62-86c7-44c0-b2a5-890105837055-signing-cabundle\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.745820 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.745693 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/31c3ff62-86c7-44c0-b2a5-890105837055-signing-cabundle\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.748637 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.748089 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/31c3ff62-86c7-44c0-b2a5-890105837055-signing-key\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.761061 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.761035 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zgxd\" (UniqueName: \"kubernetes.io/projected/31c3ff62-86c7-44c0-b2a5-890105837055-kube-api-access-9zgxd\") pod \"service-ca-67d667c7d-565lp\" (UID: \"31c3ff62-86c7-44c0-b2a5-890105837055\") " pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:11.862381 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:11.862291 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-565lp" May 25 07:38:12.007720 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:12.007688 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-565lp"] May 25 07:38:12.011646 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:12.011620 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c3ff62_86c7_44c0_b2a5_890105837055.slice/crio-04c70b0e725852faf83dcfc08c40e0d4fe04bc80e60c4d5e077be48cdafa7583 WatchSource:0}: Error finding container 04c70b0e725852faf83dcfc08c40e0d4fe04bc80e60c4d5e077be48cdafa7583: Status 404 returned error can't find the container with id 04c70b0e725852faf83dcfc08c40e0d4fe04bc80e60c4d5e077be48cdafa7583 May 25 07:38:12.145868 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:12.145784 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-565lp" event={"ID":"31c3ff62-86c7-44c0-b2a5-890105837055","Type":"ContainerStarted","Data":"9a61e1bc9a9ad0c88927b37d0de88a42d6d9de1e03cad91a3f6c936fe9bae3a4"} May 25 07:38:12.145868 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:12.145819 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-565lp" event={"ID":"31c3ff62-86c7-44c0-b2a5-890105837055","Type":"ContainerStarted","Data":"04c70b0e725852faf83dcfc08c40e0d4fe04bc80e60c4d5e077be48cdafa7583"} May 25 07:38:12.190389 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:12.190331 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-565lp" podStartSLOduration=1.190293208 podStartE2EDuration="1.190293208s" podCreationTimestamp="2026-05-25 07:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 07:38:12.189559636 +0000 UTC m=+138.049459259" watchObservedRunningTime="2026-05-25 07:38:12.190293208 +0000 UTC m=+138.050192832" May 25 07:38:12.550235 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:12.550198 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:38:12.550416 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:12.550306 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 07:38:12.550416 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:12.550374 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls podName:3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:28.550360148 +0000 UTC m=+154.410259749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls") pod "cluster-samples-operator-697587599-r4bw7" (UID: "3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8") : secret "samples-operator-tls" not found May 25 07:38:25.550630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.550593 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:25.551010 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.550662 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:25.551274 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.551254 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e4cd46-7c1f-4356-ae55-9932adfd6881-service-ca-bundle\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:25.553145 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.553123 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2e4cd46-7c1f-4356-ae55-9932adfd6881-metrics-certs\") pod \"router-default-55f99b4774-qfczw\" (UID: \"d2e4cd46-7c1f-4356-ae55-9932adfd6881\") " pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:25.850684 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.850589 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s2kct\"" May 25 07:38:25.857767 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.857743 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:25.998080 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:25.998055 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55f99b4774-qfczw"] May 25 07:38:26.000401 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:26.000363 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e4cd46_7c1f_4356_ae55_9932adfd6881.slice/crio-486ec66f20ee56295bfd1de4de10f286a78461e924d8b2f6f3f7f4c082ccf923 WatchSource:0}: Error finding container 486ec66f20ee56295bfd1de4de10f286a78461e924d8b2f6f3f7f4c082ccf923: Status 404 returned error can't find the container with id 486ec66f20ee56295bfd1de4de10f286a78461e924d8b2f6f3f7f4c082ccf923 May 25 07:38:26.182401 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:26.182294 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55f99b4774-qfczw" event={"ID":"d2e4cd46-7c1f-4356-ae55-9932adfd6881","Type":"ContainerStarted","Data":"392c59323dadaf4c00139dbed46d7950886daf7c6b0f31fc04043d4f2fa236f7"} May 25 07:38:26.182401 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:26.182357 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55f99b4774-qfczw" event={"ID":"d2e4cd46-7c1f-4356-ae55-9932adfd6881","Type":"ContainerStarted","Data":"486ec66f20ee56295bfd1de4de10f286a78461e924d8b2f6f3f7f4c082ccf923"} May 25 07:38:26.219412 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:26.219369 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-55f99b4774-qfczw" podStartSLOduration=33.219353826 podStartE2EDuration="33.219353826s" podCreationTimestamp="2026-05-25 07:37:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 07:38:26.218029756 +0000 UTC m=+152.077929379" watchObservedRunningTime="2026-05-25 07:38:26.219353826 +0000 UTC m=+152.079253448" May 25 07:38:26.858266 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:26.858228 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:26.860692 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:26.860671 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:27.186221 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:27.186178 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:27.187432 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:27.187409 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55f99b4774-qfczw" May 25 07:38:28.573657 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:28.573623 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:38:28.576181 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:28.576156 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-r4bw7\" (UID: \"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:38:28.848048 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:28.847967 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" May 25 07:38:28.983534 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:28.983500 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7"] May 25 07:38:29.192020 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:29.191985 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" event={"ID":"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8","Type":"ContainerStarted","Data":"067882a556822c149dd4541d586cc5425aa270d6c8f6481fc03993c9100dd27f"} May 25 07:38:31.198430 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:31.198394 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" event={"ID":"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8","Type":"ContainerStarted","Data":"d0f69737dddfd34081e118734256f733718ac98ac4573e0b7df46e673db9e28e"} May 25 07:38:31.198430 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:31.198429 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" event={"ID":"3fc5c4c7-a08b-4d9b-a07c-36131fbfd1d8","Type":"ContainerStarted","Data":"20871c7ab033e8e323c2be1264c7f0fc13f1da1828c8b8c3cfc213c44df7cec5"} May 25 07:38:31.584198 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:31.584102 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-wqnbv" podUID="5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0" May 25 07:38:31.590197 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:31.590170 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-k6gm4" podUID="35bafe66-39dd-4d27-b26a-1e932b8bda7a" May 25 07:38:31.754449 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:31.754408 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mbfkd" podUID="2bfb5b83-eb3f-499f-8643-cbe882eb483b" May 25 07:38:32.018085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.018035 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-r4bw7" podStartSLOduration=34.377872415 podStartE2EDuration="36.018020363s" podCreationTimestamp="2026-05-25 07:37:56 +0000 UTC" firstStartedPulling="2026-05-25 07:38:29.026652416 +0000 UTC m=+154.886552017" lastFinishedPulling="2026-05-25 07:38:30.666800361 +0000 UTC m=+156.526699965" observedRunningTime="2026-05-25 07:38:31.222994703 +0000 UTC m=+157.082894339" watchObservedRunningTime="2026-05-25 07:38:32.018020363 +0000 UTC m=+157.877919994" May 25 07:38:32.019085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.019064 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z486f"] May 25 07:38:32.022063 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.022047 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.029664 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.029643 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 07:38:32.033337 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:32.033287 2550 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" May 25 07:38:32.033535 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.033513 2550 status_manager.go:895] "Failed to get status for pod" podUID="268adfe4-7c8a-472e-b539-8c1bc0df25c2" pod="openshift-insights/insights-runtime-extractor-z486f" err="pods \"insights-runtime-extractor-z486f\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" May 25 07:38:32.034910 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:32.034886 2550 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" May 25 07:38:32.034910 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:32.034890 2550 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-mzvwx\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mzvwx\"" type="*v1.Secret" May 25 07:38:32.035020 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:32.034892 2550 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" May 25 07:38:32.072788 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.072756 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z486f"] May 25 07:38:32.073596 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.073573 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v"] May 25 07:38:32.076426 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.076408 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:32.079538 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.079520 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kv5fk\"" May 25 07:38:32.082933 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.082913 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 25 07:38:32.091910 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.091852 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v"] May 25 07:38:32.103463 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.103440 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/268adfe4-7c8a-472e-b539-8c1bc0df25c2-crio-socket\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.103557 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.103503 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268adfe4-7c8a-472e-b539-8c1bc0df25c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.103557 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.103539 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9cf\" (UniqueName: \"kubernetes.io/projected/268adfe4-7c8a-472e-b539-8c1bc0df25c2-kube-api-access-4q9cf\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.103646 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.103572 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/268adfe4-7c8a-472e-b539-8c1bc0df25c2-data-volume\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.103646 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.103626 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/268adfe4-7c8a-472e-b539-8c1bc0df25c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.200643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.200613 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k6gm4" May 25 07:38:32.204242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204221 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/268adfe4-7c8a-472e-b539-8c1bc0df25c2-data-volume\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.204345 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204250 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/268adfe4-7c8a-472e-b539-8c1bc0df25c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.204397 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204370 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/268adfe4-7c8a-472e-b539-8c1bc0df25c2-crio-socket\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.204446 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204404 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268adfe4-7c8a-472e-b539-8c1bc0df25c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.204446 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204429 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9cf\" (UniqueName: \"kubernetes.io/projected/268adfe4-7c8a-472e-b539-8c1bc0df25c2-kube-api-access-4q9cf\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.204533 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204493 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6397ec5-d44e-4904-94fd-4927bcb6ec86-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v\" (UID: \"b6397ec5-d44e-4904-94fd-4927bcb6ec86\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:32.204533 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204496 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/268adfe4-7c8a-472e-b539-8c1bc0df25c2-crio-socket\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.204614 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.204547 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/268adfe4-7c8a-472e-b539-8c1bc0df25c2-data-volume\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:32.305272 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.305231 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6397ec5-d44e-4904-94fd-4927bcb6ec86-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v\" (UID: \"b6397ec5-d44e-4904-94fd-4927bcb6ec86\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:32.307748 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.307726 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6397ec5-d44e-4904-94fd-4927bcb6ec86-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v\" (UID: \"b6397ec5-d44e-4904-94fd-4927bcb6ec86\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:32.385360 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.385231 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:32.530362 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:32.530327 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v"] May 25 07:38:32.532960 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:32.532926 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6397ec5_d44e_4904_94fd_4927bcb6ec86.slice/crio-42fd98c244b2025cbdcf0426890ce1c8d352fa74287e1df73365fc06294452fd WatchSource:0}: Error finding container 42fd98c244b2025cbdcf0426890ce1c8d352fa74287e1df73365fc06294452fd: Status 404 returned error can't find the container with id 42fd98c244b2025cbdcf0426890ce1c8d352fa74287e1df73365fc06294452fd May 25 07:38:33.019488 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.019459 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 07:38:33.029242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.029211 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9cf\" (UniqueName: \"kubernetes.io/projected/268adfe4-7c8a-472e-b539-8c1bc0df25c2-kube-api-access-4q9cf\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:33.059128 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.059097 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 07:38:33.064747 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.064723 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/268adfe4-7c8a-472e-b539-8c1bc0df25c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:33.204595 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:33.204565 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition May 25 07:38:33.205051 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:33.204646 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268adfe4-7c8a-472e-b539-8c1bc0df25c2-insights-runtime-extractor-tls podName:268adfe4-7c8a-472e-b539-8c1bc0df25c2 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:33.704624897 +0000 UTC m=+159.564524503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/268adfe4-7c8a-472e-b539-8c1bc0df25c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z486f" (UID: "268adfe4-7c8a-472e-b539-8c1bc0df25c2") : failed to sync secret cache: timed out waiting for the condition May 25 07:38:33.205051 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.204707 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" event={"ID":"b6397ec5-d44e-4904-94fd-4927bcb6ec86","Type":"ContainerStarted","Data":"42fd98c244b2025cbdcf0426890ce1c8d352fa74287e1df73365fc06294452fd"} May 25 07:38:33.303389 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.303295 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 07:38:33.560481 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.560391 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mzvwx\"" May 25 07:38:33.717492 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.717449 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268adfe4-7c8a-472e-b539-8c1bc0df25c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:33.719925 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.719898 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268adfe4-7c8a-472e-b539-8c1bc0df25c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z486f\" (UID: \"268adfe4-7c8a-472e-b539-8c1bc0df25c2\") " pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:33.830824 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.830719 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z486f" May 25 07:38:33.967719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:33.967686 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z486f"] May 25 07:38:33.970664 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:33.970637 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268adfe4_7c8a_472e_b539_8c1bc0df25c2.slice/crio-6b20ecc2c2d9c12c3900e9fdb6802b2fa4b3065e75f0c0964360f46d108dcc39 WatchSource:0}: Error finding container 6b20ecc2c2d9c12c3900e9fdb6802b2fa4b3065e75f0c0964360f46d108dcc39: Status 404 returned error can't find the container with id 6b20ecc2c2d9c12c3900e9fdb6802b2fa4b3065e75f0c0964360f46d108dcc39 May 25 07:38:34.208392 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.208359 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" event={"ID":"b6397ec5-d44e-4904-94fd-4927bcb6ec86","Type":"ContainerStarted","Data":"27132a24211ba6226b36540104a5c25b13fd761ab61cb9a59c48bc29de0065f1"} May 25 07:38:34.208847 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.208524 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:34.209843 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.209819 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z486f" event={"ID":"268adfe4-7c8a-472e-b539-8c1bc0df25c2","Type":"ContainerStarted","Data":"b8aaa026a1b2aeec249b00752f0fcbdc8bdb00d0166ac160d3e9d47fcd61a96b"} May 25 07:38:34.209843 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.209846 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z486f" event={"ID":"268adfe4-7c8a-472e-b539-8c1bc0df25c2","Type":"ContainerStarted","Data":"6b20ecc2c2d9c12c3900e9fdb6802b2fa4b3065e75f0c0964360f46d108dcc39"} May 25 07:38:34.214159 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.214139 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" May 25 07:38:34.231735 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.231686 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v" podStartSLOduration=1.136413267 podStartE2EDuration="2.231671728s" podCreationTimestamp="2026-05-25 07:38:32 +0000 UTC" firstStartedPulling="2026-05-25 07:38:32.534847481 +0000 UTC m=+158.394747083" lastFinishedPulling="2026-05-25 07:38:33.630105926 +0000 UTC m=+159.490005544" observedRunningTime="2026-05-25 07:38:34.230557952 +0000 UTC m=+160.090457576" watchObservedRunningTime="2026-05-25 07:38:34.231671728 +0000 UTC m=+160.091571352" May 25 07:38:34.803403 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.803365 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9h96r"] May 25 07:38:34.806664 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.806647 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:34.812550 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.812526 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 07:38:34.812674 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.812580 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 25 07:38:34.812674 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.812652 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 25 07:38:34.812792 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.812688 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6nlxd\"" May 25 07:38:34.812962 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.812942 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 07:38:34.813088 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.812972 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 07:38:34.825872 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.825800 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9h96r"] May 25 07:38:34.927583 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.927502 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfdd7292-58d8-491c-8d4c-7db7180795e3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:34.927583 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.927543 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfdd7292-58d8-491c-8d4c-7db7180795e3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:34.927583 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.927569 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkpkm\" (UniqueName: \"kubernetes.io/projected/cfdd7292-58d8-491c-8d4c-7db7180795e3-kube-api-access-tkpkm\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:34.927836 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:34.927631 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfdd7292-58d8-491c-8d4c-7db7180795e3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.028742 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.028701 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfdd7292-58d8-491c-8d4c-7db7180795e3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.028923 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.028756 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfdd7292-58d8-491c-8d4c-7db7180795e3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.028923 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.028780 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkpkm\" (UniqueName: \"kubernetes.io/projected/cfdd7292-58d8-491c-8d4c-7db7180795e3-kube-api-access-tkpkm\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.028923 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.028837 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfdd7292-58d8-491c-8d4c-7db7180795e3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.029638 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.029610 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfdd7292-58d8-491c-8d4c-7db7180795e3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.031453 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.031426 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfdd7292-58d8-491c-8d4c-7db7180795e3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.031783 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.031759 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfdd7292-58d8-491c-8d4c-7db7180795e3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.043489 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.043461 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkpkm\" (UniqueName: \"kubernetes.io/projected/cfdd7292-58d8-491c-8d4c-7db7180795e3-kube-api-access-tkpkm\") pod \"prometheus-operator-7779bbdd78-9h96r\" (UID: \"cfdd7292-58d8-491c-8d4c-7db7180795e3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.115887 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.115804 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" May 25 07:38:35.215790 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.215737 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z486f" event={"ID":"268adfe4-7c8a-472e-b539-8c1bc0df25c2","Type":"ContainerStarted","Data":"d024363d81cf6c33c94d1ed910ee8e91ea5e37ef35330b19a1a63cda2cbb0548"} May 25 07:38:35.267982 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:35.267944 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9h96r"] May 25 07:38:35.271307 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:35.271276 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdd7292_58d8_491c_8d4c_7db7180795e3.slice/crio-5fe7d1d009360ed87027c2f9a93c5e9eb8c61f0702ac96bdd9f82944a5897bd3 WatchSource:0}: Error finding container 5fe7d1d009360ed87027c2f9a93c5e9eb8c61f0702ac96bdd9f82944a5897bd3: Status 404 returned error can't find the container with id 5fe7d1d009360ed87027c2f9a93c5e9eb8c61f0702ac96bdd9f82944a5897bd3 May 25 07:38:36.219997 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.219944 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z486f" event={"ID":"268adfe4-7c8a-472e-b539-8c1bc0df25c2","Type":"ContainerStarted","Data":"476f8f43281078b4e35ed13e193d5a365d8201f25e460c1ddcbdf84737706c30"} May 25 07:38:36.221248 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.221222 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" event={"ID":"cfdd7292-58d8-491c-8d4c-7db7180795e3","Type":"ContainerStarted","Data":"5fe7d1d009360ed87027c2f9a93c5e9eb8c61f0702ac96bdd9f82944a5897bd3"} May 25 07:38:36.247476 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.247415 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z486f" podStartSLOduration=3.512523079 podStartE2EDuration="5.247396769s" podCreationTimestamp="2026-05-25 07:38:31 +0000 UTC" firstStartedPulling="2026-05-25 07:38:34.022274325 +0000 UTC m=+159.882173929" lastFinishedPulling="2026-05-25 07:38:35.757148007 +0000 UTC m=+161.617047619" observedRunningTime="2026-05-25 07:38:36.246143719 +0000 UTC m=+162.106043341" watchObservedRunningTime="2026-05-25 07:38:36.247396769 +0000 UTC m=+162.107296392" May 25 07:38:36.541868 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.541779 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:38:36.541868 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.541828 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:38:36.544335 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.544285 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bafe66-39dd-4d27-b26a-1e932b8bda7a-metrics-tls\") pod \"dns-default-k6gm4\" (UID: \"35bafe66-39dd-4d27-b26a-1e932b8bda7a\") " pod="openshift-dns/dns-default-k6gm4" May 25 07:38:36.544471 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.544401 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0-cert\") pod \"ingress-canary-wqnbv\" (UID: \"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0\") " pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:38:36.704493 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.704473 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qnmnv\"" May 25 07:38:36.712040 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.712017 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k6gm4" May 25 07:38:36.857792 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:36.857758 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k6gm4"] May 25 07:38:36.861347 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:36.861274 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bafe66_39dd_4d27_b26a_1e932b8bda7a.slice/crio-353d6d4950a3ebd389bd6294c211cb275155b2d689c6907493266f68193e834f WatchSource:0}: Error finding container 353d6d4950a3ebd389bd6294c211cb275155b2d689c6907493266f68193e834f: Status 404 returned error can't find the container with id 353d6d4950a3ebd389bd6294c211cb275155b2d689c6907493266f68193e834f May 25 07:38:37.224849 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:37.224809 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k6gm4" event={"ID":"35bafe66-39dd-4d27-b26a-1e932b8bda7a","Type":"ContainerStarted","Data":"353d6d4950a3ebd389bd6294c211cb275155b2d689c6907493266f68193e834f"} May 25 07:38:37.226367 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:37.226343 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" event={"ID":"cfdd7292-58d8-491c-8d4c-7db7180795e3","Type":"ContainerStarted","Data":"dca650cec589f7e36c36e281dd25a723a0df0a22f4864a605b3c2a47b9891771"} May 25 07:38:37.226474 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:37.226376 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" event={"ID":"cfdd7292-58d8-491c-8d4c-7db7180795e3","Type":"ContainerStarted","Data":"f880af1c080d55019fcae5c290c946bb6b4f87ac6cfe160992783a6579d3bd54"} May 25 07:38:37.251955 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:37.251902 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9h96r" podStartSLOduration=1.93122951 podStartE2EDuration="3.251888453s" podCreationTimestamp="2026-05-25 07:38:34 +0000 UTC" firstStartedPulling="2026-05-25 07:38:35.273424664 +0000 UTC m=+161.133324281" lastFinishedPulling="2026-05-25 07:38:36.594083609 +0000 UTC m=+162.453983224" observedRunningTime="2026-05-25 07:38:37.251343764 +0000 UTC m=+163.111243383" watchObservedRunningTime="2026-05-25 07:38:37.251888453 +0000 UTC m=+163.111788076" May 25 07:38:39.233924 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.233887 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k6gm4" event={"ID":"35bafe66-39dd-4d27-b26a-1e932b8bda7a","Type":"ContainerStarted","Data":"c887718fbfacdf5813c67d405dbd55cbb1e5152621505f46916063e296ff36c3"} May 25 07:38:39.233924 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.233924 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k6gm4" event={"ID":"35bafe66-39dd-4d27-b26a-1e932b8bda7a","Type":"ContainerStarted","Data":"8e8bc93284ceaff798a118c4e67959f4923454917aa3c7ecf1b309b00ce2e81c"} May 25 07:38:39.234417 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.234022 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k6gm4" May 25 07:38:39.274684 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.274620 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-k6gm4" podStartSLOduration=129.813816665 podStartE2EDuration="2m11.274602501s" podCreationTimestamp="2026-05-25 07:36:28 +0000 UTC" firstStartedPulling="2026-05-25 07:38:36.863581354 +0000 UTC m=+162.723480957" lastFinishedPulling="2026-05-25 07:38:38.324367186 +0000 UTC m=+164.184266793" observedRunningTime="2026-05-25 07:38:39.272403415 +0000 UTC m=+165.132303039" watchObservedRunningTime="2026-05-25 07:38:39.274602501 +0000 UTC m=+165.134502125" May 25 07:38:39.455695 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.455662 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk"] May 25 07:38:39.458527 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.458511 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.462645 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.462611 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 25 07:38:39.463687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.463666 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 25 07:38:39.464097 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.464080 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rcczw\"" May 25 07:38:39.481137 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.481106 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk"] May 25 07:38:39.507406 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.507337 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jflvj"] May 25 07:38:39.510360 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.510342 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9"] May 25 07:38:39.510534 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.510516 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.513339 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.513302 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.514289 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.514270 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 07:38:39.514886 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.514859 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 07:38:39.515205 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.515187 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 07:38:39.515339 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.515300 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2zdnp\"" May 25 07:38:39.516659 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.516641 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 25 07:38:39.516753 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.516710 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 25 07:38:39.516856 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.516838 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 25 07:38:39.516925 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.516860 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pxg9x\"" May 25 07:38:39.537282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.537258 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9"] May 25 07:38:39.568596 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.568574 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.568731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.568625 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2850baa8-65d6-43e2-99b7-a23a97670fc6-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.568731 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.568646 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.568837 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.568763 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnwxr\" (UniqueName: \"kubernetes.io/projected/2850baa8-65d6-43e2-99b7-a23a97670fc6-kube-api-access-mnwxr\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.672944 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.672892 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673000 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673042 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjzd\" (UniqueName: \"kubernetes.io/projected/99584619-73ba-4936-befc-8bd78c1022ea-kube-api-access-jrjzd\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673077 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-sys\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673111 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.673369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673147 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2850baa8-65d6-43e2-99b7-a23a97670fc6-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.673369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673179 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-root\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673220 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.673369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673252 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99584619-73ba-4936-befc-8bd78c1022ea-metrics-client-ca\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673290 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-wtmp\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673369 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673351 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55f12f9c-a582-4328-b56c-5d18b830c7c8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673391 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-textfile\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673428 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55f12f9c-a582-4328-b56c-5d18b830c7c8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673474 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673512 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwxj\" (UniqueName: \"kubernetes.io/projected/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-api-access-hwwxj\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673541 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnwxr\" (UniqueName: \"kubernetes.io/projected/2850baa8-65d6-43e2-99b7-a23a97670fc6-kube-api-access-mnwxr\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673580 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673619 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.673717 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.673648 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-tls\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.674711 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:39.674686 2550 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 25 07:38:39.674870 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:39.674802 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-tls podName:2850baa8-65d6-43e2-99b7-a23a97670fc6 nodeName:}" failed. No retries permitted until 2026-05-25 07:38:40.174781561 +0000 UTC m=+166.034681162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-5tfsk" (UID: "2850baa8-65d6-43e2-99b7-a23a97670fc6") : secret "openshift-state-metrics-tls" not found May 25 07:38:39.674969 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.674898 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2850baa8-65d6-43e2-99b7-a23a97670fc6-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.677036 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.677009 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.691391 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.691364 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnwxr\" (UniqueName: \"kubernetes.io/projected/2850baa8-65d6-43e2-99b7-a23a97670fc6-kube-api-access-mnwxr\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:39.774372 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774293 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-tls\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774372 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774345 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774554 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:39.774445 2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 25 07:38:39.774554 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774469 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774554 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:38:39.774516 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-tls podName:99584619-73ba-4936-befc-8bd78c1022ea nodeName:}" failed. No retries permitted until 2026-05-25 07:38:40.274497421 +0000 UTC m=+166.134397028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-tls") pod "node-exporter-jflvj" (UID: "99584619-73ba-4936-befc-8bd78c1022ea") : secret "node-exporter-tls" not found May 25 07:38:39.774729 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774552 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjzd\" (UniqueName: \"kubernetes.io/projected/99584619-73ba-4936-befc-8bd78c1022ea-kube-api-access-jrjzd\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774729 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774583 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-sys\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774729 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774635 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-sys\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774718 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774770 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-root\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774804 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99584619-73ba-4936-befc-8bd78c1022ea-metrics-client-ca\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774840 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-wtmp\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774872 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-root\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774880 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55f12f9c-a582-4328-b56c-5d18b830c7c8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.774932 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774931 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-textfile\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.775275 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.774968 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55f12f9c-a582-4328-b56c-5d18b830c7c8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.775275 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775042 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.775275 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775051 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.775275 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775161 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwxj\" (UniqueName: \"kubernetes.io/projected/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-api-access-hwwxj\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.775275 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775252 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55f12f9c-a582-4328-b56c-5d18b830c7c8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.775546 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775339 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-textfile\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.775546 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775440 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99584619-73ba-4936-befc-8bd78c1022ea-metrics-client-ca\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.775649 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775252 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.775719 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.775662 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-wtmp\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.776102 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.776075 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.776629 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.776608 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55f12f9c-a582-4328-b56c-5d18b830c7c8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.777519 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.777500 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.777613 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.777583 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.777758 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.777740 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.800474 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.800454 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjzd\" (UniqueName: \"kubernetes.io/projected/99584619-73ba-4936-befc-8bd78c1022ea-kube-api-access-jrjzd\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:39.818535 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.818517 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwxj\" (UniqueName: \"kubernetes.io/projected/55f12f9c-a582-4328-b56c-5d18b830c7c8-kube-api-access-hwwxj\") pod \"kube-state-metrics-54fd6bc5c4-cvbf9\" (UID: \"55f12f9c-a582-4328-b56c-5d18b830c7c8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.825801 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.825780 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" May 25 07:38:39.970253 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:39.970224 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9"] May 25 07:38:39.971951 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:39.971916 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f12f9c_a582_4328_b56c_5d18b830c7c8.slice/crio-1f0eef0529f97c2d43d3d422a7e50d54de347b2e63de317c6621a454f3d096e0 WatchSource:0}: Error finding container 1f0eef0529f97c2d43d3d422a7e50d54de347b2e63de317c6621a454f3d096e0: Status 404 returned error can't find the container with id 1f0eef0529f97c2d43d3d422a7e50d54de347b2e63de317c6621a454f3d096e0 May 25 07:38:40.179138 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.179045 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:40.181571 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.181545 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2850baa8-65d6-43e2-99b7-a23a97670fc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-5tfsk\" (UID: \"2850baa8-65d6-43e2-99b7-a23a97670fc6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:40.237692 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.237654 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" event={"ID":"55f12f9c-a582-4328-b56c-5d18b830c7c8","Type":"ContainerStarted","Data":"1f0eef0529f97c2d43d3d422a7e50d54de347b2e63de317c6621a454f3d096e0"} May 25 07:38:40.280492 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.280461 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-tls\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:40.283246 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.283220 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99584619-73ba-4936-befc-8bd78c1022ea-node-exporter-tls\") pod \"node-exporter-jflvj\" (UID: \"99584619-73ba-4936-befc-8bd78c1022ea\") " pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:40.368712 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.368682 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" May 25 07:38:40.420667 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.420632 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jflvj" May 25 07:38:40.432477 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:40.432411 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99584619_73ba_4936_befc_8bd78c1022ea.slice/crio-792d8846ab31c6ef56f2748b9336b2e77c3a4394e66f9dbe49462ba483bf3ba6 WatchSource:0}: Error finding container 792d8846ab31c6ef56f2748b9336b2e77c3a4394e66f9dbe49462ba483bf3ba6: Status 404 returned error can't find the container with id 792d8846ab31c6ef56f2748b9336b2e77c3a4394e66f9dbe49462ba483bf3ba6 May 25 07:38:40.514565 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:40.514537 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk"] May 25 07:38:40.516605 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:40.516580 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2850baa8_65d6_43e2_99b7_a23a97670fc6.slice/crio-8c4f2be58fa38b9017a8630f09263bf46744bb2c9ac8cff456ec2be4406bfa08 WatchSource:0}: Error finding container 8c4f2be58fa38b9017a8630f09263bf46744bb2c9ac8cff456ec2be4406bfa08: Status 404 returned error can't find the container with id 8c4f2be58fa38b9017a8630f09263bf46744bb2c9ac8cff456ec2be4406bfa08 May 25 07:38:41.242253 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:41.242212 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jflvj" event={"ID":"99584619-73ba-4936-befc-8bd78c1022ea","Type":"ContainerStarted","Data":"792d8846ab31c6ef56f2748b9336b2e77c3a4394e66f9dbe49462ba483bf3ba6"} May 25 07:38:41.244129 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:41.244099 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" event={"ID":"2850baa8-65d6-43e2-99b7-a23a97670fc6","Type":"ContainerStarted","Data":"62f93fc1434174f72c22e45f3e4a47a89844c5ee8c2b0097ce418db83988268e"} May 25 07:38:41.244234 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:41.244133 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" event={"ID":"2850baa8-65d6-43e2-99b7-a23a97670fc6","Type":"ContainerStarted","Data":"6a79f7ed09190ed0bdbe598a848f01c6e317adbe3d4de3e8e112f996bffc53df"} May 25 07:38:41.244234 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:41.244142 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" event={"ID":"2850baa8-65d6-43e2-99b7-a23a97670fc6","Type":"ContainerStarted","Data":"8c4f2be58fa38b9017a8630f09263bf46744bb2c9ac8cff456ec2be4406bfa08"} May 25 07:38:42.248246 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.248212 2550 generic.go:358] "Generic (PLEG): container finished" podID="99584619-73ba-4936-befc-8bd78c1022ea" containerID="f3bd0904685c2bbea25a6facb8f15d4df71e4ce69a986eb20bf1085477048abe" exitCode=0 May 25 07:38:42.248649 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.248283 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jflvj" event={"ID":"99584619-73ba-4936-befc-8bd78c1022ea","Type":"ContainerDied","Data":"f3bd0904685c2bbea25a6facb8f15d4df71e4ce69a986eb20bf1085477048abe"} May 25 07:38:42.250447 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.250381 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" event={"ID":"2850baa8-65d6-43e2-99b7-a23a97670fc6","Type":"ContainerStarted","Data":"210a628984f1160577d03eba7abb6370362ce3690339f540c0bbef1fbc26cb09"} May 25 07:38:42.256673 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.256649 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" event={"ID":"55f12f9c-a582-4328-b56c-5d18b830c7c8","Type":"ContainerStarted","Data":"8879167a7e86b6d032571d24720a15f88c42c92019a17acc811652f52efc2384"} May 25 07:38:42.256794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.256679 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" event={"ID":"55f12f9c-a582-4328-b56c-5d18b830c7c8","Type":"ContainerStarted","Data":"53235ff0fe85d2cdff871ab021e1701485030278bf82ae3fddba13fb5cf5b6f6"} May 25 07:38:42.256794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.256688 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" event={"ID":"55f12f9c-a582-4328-b56c-5d18b830c7c8","Type":"ContainerStarted","Data":"deacbee560f4b0f87e9fd7128b93910da67863c8dfe67059178487fca2c0bb8e"} May 25 07:38:42.291076 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.291032 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-5tfsk" podStartSLOduration=1.904902503 podStartE2EDuration="3.291014015s" podCreationTimestamp="2026-05-25 07:38:39 +0000 UTC" firstStartedPulling="2026-05-25 07:38:40.656238169 +0000 UTC m=+166.516137781" lastFinishedPulling="2026-05-25 07:38:42.042349691 +0000 UTC m=+167.902249293" observedRunningTime="2026-05-25 07:38:42.28997128 +0000 UTC m=+168.149870903" watchObservedRunningTime="2026-05-25 07:38:42.291014015 +0000 UTC m=+168.150913642" May 25 07:38:42.321592 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.321545 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-cvbf9" podStartSLOduration=1.745855766 podStartE2EDuration="3.321526728s" podCreationTimestamp="2026-05-25 07:38:39 +0000 UTC" firstStartedPulling="2026-05-25 07:38:39.973819354 +0000 UTC m=+165.833718956" lastFinishedPulling="2026-05-25 07:38:41.549490304 +0000 UTC m=+167.409389918" observedRunningTime="2026-05-25 07:38:42.319623517 +0000 UTC m=+168.179523144" watchObservedRunningTime="2026-05-25 07:38:42.321526728 +0000 UTC m=+168.181426352" May 25 07:38:42.526083 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.525997 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx"] May 25 07:38:42.530360 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.530338 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.534293 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.534273 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 25 07:38:42.534566 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.534551 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 25 07:38:42.534855 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.534836 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 25 07:38:42.535067 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.535052 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8jk6k0sm6vu2k\"" May 25 07:38:42.535995 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.535959 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hql7m\"" May 25 07:38:42.535995 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.535977 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 25 07:38:42.540080 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.540061 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 25 07:38:42.649833 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.649797 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx"] May 25 07:38:42.701549 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701522 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-tls\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701721 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701564 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701721 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701596 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-grpc-tls\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701721 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701622 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701721 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701651 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v529w\" (UniqueName: \"kubernetes.io/projected/31436560-7bfc-4dd5-b4d4-869506095d16-kube-api-access-v529w\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701721 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701690 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31436560-7bfc-4dd5-b4d4-869506095d16-metrics-client-ca\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701877 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701744 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.701877 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.701774 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802364 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31436560-7bfc-4dd5-b4d4-869506095d16-metrics-client-ca\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802421 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802441 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802488 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-tls\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802508 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802527 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-grpc-tls\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802549 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.802732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.802583 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v529w\" (UniqueName: \"kubernetes.io/projected/31436560-7bfc-4dd5-b4d4-869506095d16-kube-api-access-v529w\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.803180 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.803152 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31436560-7bfc-4dd5-b4d4-869506095d16-metrics-client-ca\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.805234 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.805212 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.805404 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.805381 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-tls\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.805732 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.805706 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.805872 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.805855 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.805926 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.805875 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-grpc-tls\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.805926 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.805876 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/31436560-7bfc-4dd5-b4d4-869506095d16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.819255 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.819225 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v529w\" (UniqueName: \"kubernetes.io/projected/31436560-7bfc-4dd5-b4d4-869506095d16-kube-api-access-v529w\") pod \"thanos-querier-7d7cb6dd49-9tfqx\" (UID: \"31436560-7bfc-4dd5-b4d4-869506095d16\") " pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.839151 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.839126 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:42.982924 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:42.982867 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx"] May 25 07:38:42.986170 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:42.986142 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31436560_7bfc_4dd5_b4d4_869506095d16.slice/crio-41a8de7c70f71ea1b49cdb24eb5e726a4ae2916f9bd4c341d9efcd269ea02ac8 WatchSource:0}: Error finding container 41a8de7c70f71ea1b49cdb24eb5e726a4ae2916f9bd4c341d9efcd269ea02ac8: Status 404 returned error can't find the container with id 41a8de7c70f71ea1b49cdb24eb5e726a4ae2916f9bd4c341d9efcd269ea02ac8 May 25 07:38:43.261211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:43.261175 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jflvj" event={"ID":"99584619-73ba-4936-befc-8bd78c1022ea","Type":"ContainerStarted","Data":"845eb1dfeb00e94522f9311b387b3a40ec3a8168956e592f4516a84e7963244e"} May 25 07:38:43.261211 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:43.261215 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jflvj" event={"ID":"99584619-73ba-4936-befc-8bd78c1022ea","Type":"ContainerStarted","Data":"b8bde2b8a0c9637a94abf4cbdfee26d07443e1c63f8b94411913807d31e2d8eb"} May 25 07:38:43.262205 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:43.262183 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"41a8de7c70f71ea1b49cdb24eb5e726a4ae2916f9bd4c341d9efcd269ea02ac8"} May 25 07:38:43.317861 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:43.317808 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jflvj" podStartSLOduration=3.199926943 podStartE2EDuration="4.317792503s" podCreationTimestamp="2026-05-25 07:38:39 +0000 UTC" firstStartedPulling="2026-05-25 07:38:40.434136263 +0000 UTC m=+166.294035878" lastFinishedPulling="2026-05-25 07:38:41.552001819 +0000 UTC m=+167.411901438" observedRunningTime="2026-05-25 07:38:43.317162854 +0000 UTC m=+169.177062478" watchObservedRunningTime="2026-05-25 07:38:43.317792503 +0000 UTC m=+169.177692124" May 25 07:38:45.691681 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.691642 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:38:45.696252 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.696225 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.699345 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.699280 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 07:38:45.699713 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.699674 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 07:38:45.704173 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704021 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 07:38:45.704173 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704053 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 07:38:45.704173 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704053 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 07:38:45.704173 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704053 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 07:38:45.704604 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704579 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 07:38:45.704696 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704617 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 07:38:45.704696 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704619 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-84pp16sb7b9rl\"" May 25 07:38:45.705000 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.704977 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 07:38:45.705300 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.705277 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g6tz6\"" May 25 07:38:45.705409 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.705303 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 07:38:45.705931 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.705914 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 07:38:45.709152 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.709134 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 07:38:45.715331 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.711804 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 07:38:45.720055 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.720026 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:38:45.727707 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727683 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727813 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727724 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727813 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727756 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727889 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727816 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727889 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727861 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727961 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727889 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727961 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727911 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jzkr\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-kube-api-access-6jzkr\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727961 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727932 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.727961 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.727946 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728138 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728004 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728138 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728045 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728138 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728078 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728138 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728114 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728177 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728235 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728287 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728260 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728418 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728286 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.728418 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.728345 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.742837 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.742812 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:38:45.742931 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.742813 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:38:45.745855 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.745835 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9xn6x\"" May 25 07:38:45.753191 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.753166 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqnbv" May 25 07:38:45.829157 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829129 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829337 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829162 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829337 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829190 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829337 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829222 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829337 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829249 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829337 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829282 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829604 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829493 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.829604 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.829560 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830229 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830388 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830479 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830612 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830750 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830759 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830815 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830868 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830902 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jzkr\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-kube-api-access-6jzkr\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830949 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.830975 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.831025 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.831066 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.832158 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.831833 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835119 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.833075 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835119 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.833955 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835119 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.834053 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835119 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.834775 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835387 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.835210 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835387 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.835284 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.835571 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.835523 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.836630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.836608 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.837342 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.837277 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.838504 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.838461 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.838772 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.838749 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.839137 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.839066 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.841043 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.840303 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.853349 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.853222 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jzkr\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-kube-api-access-6jzkr\") pod \"prometheus-k8s-0\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:45.907600 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:45.907452 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqnbv"] May 25 07:38:45.910783 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:45.910751 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce80502_5fbd_41a9_b4f2_1b5cafc40eb0.slice/crio-3aef9e1a213a1f49a74452b61e90df37c8d213370dc3ed0e04fea430e5d17a9b WatchSource:0}: Error finding container 3aef9e1a213a1f49a74452b61e90df37c8d213370dc3ed0e04fea430e5d17a9b: Status 404 returned error can't find the container with id 3aef9e1a213a1f49a74452b61e90df37c8d213370dc3ed0e04fea430e5d17a9b May 25 07:38:46.007520 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.007437 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:38:46.275905 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.275871 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"b7f6ee0de0a23a7c30e2da968c93f6dc5c05a44e55d12337bdb0467abce50c13"} May 25 07:38:46.276026 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.275919 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"4188d4bd7c942e66690ade216ad1025a3be1a529f54bce672e3d49c5ba392175"} May 25 07:38:46.276026 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.275934 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"28af88362bd23810ef1d351636a1c2e2ad2a1daa6f53a56cb1bee4d70209c3ff"} May 25 07:38:46.276026 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.275948 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"3d8344c2b78435aa383fef26b53b415bfdd5cd081f3106d9f90a729d2d96c817"} May 25 07:38:46.277763 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.277724 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqnbv" event={"ID":"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0","Type":"ContainerStarted","Data":"3aef9e1a213a1f49a74452b61e90df37c8d213370dc3ed0e04fea430e5d17a9b"} May 25 07:38:46.286429 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:46.286403 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:38:46.290188 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:38:46.290159 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b444fa4_105b_4202_9fca_b4fc1b358ea4.slice/crio-817a63310b6ced543fd25d21caecc8344411273d9f491e1790dc1e74654e3361 WatchSource:0}: Error finding container 817a63310b6ced543fd25d21caecc8344411273d9f491e1790dc1e74654e3361: Status 404 returned error can't find the container with id 817a63310b6ced543fd25d21caecc8344411273d9f491e1790dc1e74654e3361 May 25 07:38:47.284004 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:47.283952 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"876ebda03f884428c11a56c4174a05ceb2e12295aa5e9fd13f2c1a37630bfe69"} May 25 07:38:47.284004 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:47.284009 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" event={"ID":"31436560-7bfc-4dd5-b4d4-869506095d16","Type":"ContainerStarted","Data":"98935829a0a8fcabdbec240d050fd56a9155713dd15315cdda843c8ef37bf78c"} May 25 07:38:47.284581 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:47.284174 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:47.285291 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:47.285258 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"817a63310b6ced543fd25d21caecc8344411273d9f491e1790dc1e74654e3361"} May 25 07:38:47.312155 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:47.312105 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" podStartSLOduration=2.142208887 podStartE2EDuration="5.31208572s" podCreationTimestamp="2026-05-25 07:38:42 +0000 UTC" firstStartedPulling="2026-05-25 07:38:42.988281033 +0000 UTC m=+168.848180634" lastFinishedPulling="2026-05-25 07:38:46.158157854 +0000 UTC m=+172.018057467" observedRunningTime="2026-05-25 07:38:47.310160512 +0000 UTC m=+173.170060158" watchObservedRunningTime="2026-05-25 07:38:47.31208572 +0000 UTC m=+173.171985345" May 25 07:38:48.289443 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:48.289408 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqnbv" event={"ID":"5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0","Type":"ContainerStarted","Data":"f9f77074e21726a59f947fcc454078e2c5246aaf57ffa80ea45fd5a6f85c1b89"} May 25 07:38:48.290757 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:48.290727 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" exitCode=0 May 25 07:38:48.290857 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:48.290809 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} May 25 07:38:48.332552 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:48.332502 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wqnbv" podStartSLOduration=138.576369209 podStartE2EDuration="2m20.332488947s" podCreationTimestamp="2026-05-25 07:36:28 +0000 UTC" firstStartedPulling="2026-05-25 07:38:45.913828459 +0000 UTC m=+171.773728064" lastFinishedPulling="2026-05-25 07:38:47.669948195 +0000 UTC m=+173.529847802" observedRunningTime="2026-05-25 07:38:48.332363759 +0000 UTC m=+174.192263382" watchObservedRunningTime="2026-05-25 07:38:48.332488947 +0000 UTC m=+174.192388630" May 25 07:38:49.240924 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:49.240894 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k6gm4" May 25 07:38:51.304821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:51.304782 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} May 25 07:38:51.304821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:51.304830 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} May 25 07:38:51.304821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:51.304844 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} May 25 07:38:52.310468 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:52.310433 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} May 25 07:38:52.310468 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:52.310471 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} May 25 07:38:52.310895 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:52.310481 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerStarted","Data":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} May 25 07:38:52.358531 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:52.358489 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.59010172 podStartE2EDuration="7.358476861s" podCreationTimestamp="2026-05-25 07:38:45 +0000 UTC" firstStartedPulling="2026-05-25 07:38:46.292219524 +0000 UTC m=+172.152119128" lastFinishedPulling="2026-05-25 07:38:51.060594667 +0000 UTC m=+176.920494269" observedRunningTime="2026-05-25 07:38:52.35815625 +0000 UTC m=+178.218055872" watchObservedRunningTime="2026-05-25 07:38:52.358476861 +0000 UTC m=+178.218376483" May 25 07:38:53.297142 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:53.297116 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d7cb6dd49-9tfqx" May 25 07:38:56.008034 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:38:56.007990 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:39:30.428532 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:30.428494 2550 generic.go:358] "Generic (PLEG): container finished" podID="c67a9311-7d6d-424a-a104-dfd75b2cada8" containerID="b549e3555e6fa5b2a151ebea3464911e0dda71404e0241d63c62d3c4aa8848fe" exitCode=0 May 25 07:39:30.428933 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:30.428571 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" event={"ID":"c67a9311-7d6d-424a-a104-dfd75b2cada8","Type":"ContainerDied","Data":"b549e3555e6fa5b2a151ebea3464911e0dda71404e0241d63c62d3c4aa8848fe"} May 25 07:39:30.428933 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:30.428888 2550 scope.go:117] "RemoveContainer" containerID="b549e3555e6fa5b2a151ebea3464911e0dda71404e0241d63c62d3c4aa8848fe" May 25 07:39:31.432971 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:31.432937 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kdbz9" event={"ID":"c67a9311-7d6d-424a-a104-dfd75b2cada8","Type":"ContainerStarted","Data":"e73bcb31d9dd6ddc0a3c9d4d2cfdd1fb7e20b8dbe4f6a7dbca0a83f141e59f9c"} May 25 07:39:33.439957 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:33.439922 2550 generic.go:358] "Generic (PLEG): container finished" podID="10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e" containerID="a1614179153dfc0d387c54165688197fdd0562b12da5b6ea47d91f663ee3198b" exitCode=0 May 25 07:39:33.440356 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:33.439996 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" event={"ID":"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e","Type":"ContainerDied","Data":"a1614179153dfc0d387c54165688197fdd0562b12da5b6ea47d91f663ee3198b"} May 25 07:39:33.440356 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:33.440341 2550 scope.go:117] "RemoveContainer" containerID="a1614179153dfc0d387c54165688197fdd0562b12da5b6ea47d91f663ee3198b" May 25 07:39:34.444860 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:34.444819 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-td2cd" event={"ID":"10f9ee2c-6668-4ee2-9cae-bb2edd41ef3e","Type":"ContainerStarted","Data":"b9666601caa8c0be463fa600e89532fc1f7528230fdaa9e2a3e9621128bd901a"} May 25 07:39:46.008515 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:46.008474 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:39:46.024787 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:46.024758 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:39:46.492904 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:39:46.492879 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.085001 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.084916 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:40:04.085502 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.085376 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="prometheus" containerID="cri-o://1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" gracePeriod=600 May 25 07:40:04.085502 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.085401 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-web" containerID="cri-o://a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" gracePeriod=600 May 25 07:40:04.085502 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.085435 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" gracePeriod=600 May 25 07:40:04.085502 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.085433 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="config-reloader" containerID="cri-o://33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" gracePeriod=600 May 25 07:40:04.085762 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.085398 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy" containerID="cri-o://c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" gracePeriod=600 May 25 07:40:04.085762 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.085567 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="thanos-sidecar" containerID="cri-o://08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" gracePeriod=600 May 25 07:40:04.343251 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.343226 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.515228 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515184 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-tls-assets\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515228 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515234 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-web-config\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515254 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-rulefiles-0\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515273 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-thanos-prometheus-http-client-file\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515307 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-trusted-ca-bundle\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515366 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-metrics-client-ca\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515392 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-kubelet-serving-ca-bundle\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515418 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-metrics-client-certs\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515446 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jzkr\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-kube-api-access-6jzkr\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515468 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515511 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-kube-rbac-proxy\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515535 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-tls\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515567 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-grpc-tls\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515605 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515636 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config-out\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515662 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-serving-certs-ca-bundle\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515694 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515715 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-db\") pod \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\" (UID: \"0b444fa4-105b-4202-9fca-b4fc1b358ea4\") " May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515738 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.515834 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.516019 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.515973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.516041 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.516686 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.516263 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 07:40:04.516686 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.516611 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 07:40:04.517402 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.517373 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 07:40:04.518105 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.518074 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 07:40:04.519124 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.518849 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.519124 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.519088 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 07:40:04.519644 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.519603 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.520262 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.520225 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.520480 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.520450 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config-out" (OuterVolumeSpecName: "config-out") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 07:40:04.520572 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.520515 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.520786 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.520765 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.520879 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.520832 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.520923 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.520901 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-kube-api-access-6jzkr" (OuterVolumeSpecName: "kube-api-access-6jzkr") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "kube-api-access-6jzkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 07:40:04.521070 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.521048 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.521504 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.521489 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config" (OuterVolumeSpecName: "config") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.530739 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530711 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" exitCode=0 May 25 07:40:04.530739 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530735 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" exitCode=0 May 25 07:40:04.530739 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530743 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" exitCode=0 May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530748 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" exitCode=0 May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530762 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" exitCode=0 May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530771 2550 generic.go:358] "Generic (PLEG): container finished" podID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" exitCode=0 May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530808 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530846 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530854 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530869 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-web-config" (OuterVolumeSpecName: "web-config") pod "0b444fa4-105b-4202-9fca-b4fc1b358ea4" (UID: "0b444fa4-105b-4202-9fca-b4fc1b358ea4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530879 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.530952 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530858 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} May 25 07:40:04.531295 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530956 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} May 25 07:40:04.531295 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530972 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} May 25 07:40:04.531295 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530984 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} May 25 07:40:04.531295 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.530993 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b444fa4-105b-4202-9fca-b4fc1b358ea4","Type":"ContainerDied","Data":"817a63310b6ced543fd25d21caecc8344411273d9f491e1790dc1e74654e3361"} May 25 07:40:04.538852 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.538622 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.546537 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.546515 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.553034 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.553018 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.558166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.558144 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:40:04.560182 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.560162 2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:40:04.560230 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.560202 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.566771 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.566747 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.573622 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.573603 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.580227 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.580209 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.580522 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.580500 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.580587 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.580529 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} err="failed to get container status \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" May 25 07:40:04.580587 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.580562 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.580802 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.580785 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.580844 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.580808 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} err="failed to get container status \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" May 25 07:40:04.580844 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.580824 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.581045 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.581031 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.581089 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581048 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} err="failed to get container status \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" May 25 07:40:04.581089 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581062 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.581286 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.581268 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.581404 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581287 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} err="failed to get container status \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" May 25 07:40:04.581404 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581301 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.581496 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.581481 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.581531 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581500 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} err="failed to get container status \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" May 25 07:40:04.581531 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581512 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.581729 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.581712 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.581771 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581734 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} err="failed to get container status \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" May 25 07:40:04.581771 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581747 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.581964 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:40:04.581947 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.582011 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581966 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} err="failed to get container status \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" May 25 07:40:04.582011 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.581981 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.582166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582151 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} err="failed to get container status \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" May 25 07:40:04.582205 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582166 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.582377 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582357 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} err="failed to get container status \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" May 25 07:40:04.582377 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582375 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.582574 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582557 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} err="failed to get container status \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" May 25 07:40:04.582646 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582576 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.582845 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582828 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} err="failed to get container status \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" May 25 07:40:04.582891 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.582847 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.583048 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583030 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} err="failed to get container status \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" May 25 07:40:04.583085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583049 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.583250 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583233 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} err="failed to get container status \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" May 25 07:40:04.583333 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583251 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.583466 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583451 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} err="failed to get container status \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" May 25 07:40:04.583513 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583468 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.583658 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583640 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} err="failed to get container status \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" May 25 07:40:04.583701 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583659 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.583847 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583831 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} err="failed to get container status \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" May 25 07:40:04.583923 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.583851 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.584064 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584049 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} err="failed to get container status \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" May 25 07:40:04.584107 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584063 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.584247 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584231 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} err="failed to get container status \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" May 25 07:40:04.584340 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584249 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.584478 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584460 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} err="failed to get container status \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" May 25 07:40:04.584519 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584479 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.584667 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584652 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} err="failed to get container status \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" May 25 07:40:04.584708 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584667 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.584842 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584828 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} err="failed to get container status \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" May 25 07:40:04.584885 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.584842 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.585030 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585014 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} err="failed to get container status \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" May 25 07:40:04.585093 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585032 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.585263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585245 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} err="failed to get container status \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" May 25 07:40:04.585303 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585264 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.585498 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585460 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} err="failed to get container status \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" May 25 07:40:04.585498 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585477 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.585671 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585653 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} err="failed to get container status \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" May 25 07:40:04.585707 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585672 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.585889 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585872 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} err="failed to get container status \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" May 25 07:40:04.585928 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.585890 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.586077 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586062 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} err="failed to get container status \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" May 25 07:40:04.586117 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586078 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.586283 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586267 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} err="failed to get container status \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" May 25 07:40:04.586283 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586281 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.586509 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586494 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} err="failed to get container status \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" May 25 07:40:04.586546 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586510 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.586737 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586721 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} err="failed to get container status \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" May 25 07:40:04.586737 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586737 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.586967 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586951 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} err="failed to get container status \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" May 25 07:40:04.587009 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.586967 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.587182 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587168 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} err="failed to get container status \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" May 25 07:40:04.587226 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587183 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.587388 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587372 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} err="failed to get container status \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" May 25 07:40:04.587388 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587387 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.587565 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587546 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} err="failed to get container status \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" May 25 07:40:04.587610 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587565 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.587806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587787 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} err="failed to get container status \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" May 25 07:40:04.587806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.587803 2550 scope.go:117] "RemoveContainer" containerID="baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034" May 25 07:40:04.588071 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588048 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034"} err="failed to get container status \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": rpc error: code = NotFound desc = could not find container \"baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034\": container with ID starting with baab02d9dcc5c25f228ae3e8fed03489a3788bc3e1e375775d7fa94fac53d034 not found: ID does not exist" May 25 07:40:04.588071 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588072 2550 scope.go:117] "RemoveContainer" containerID="c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4" May 25 07:40:04.588398 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588374 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4"} err="failed to get container status \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": rpc error: code = NotFound desc = could not find container \"c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4\": container with ID starting with c434ebdc813e43f7296392123e5f2b71f0ef8f400b212090a53672c6acab16d4 not found: ID does not exist" May 25 07:40:04.588491 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588400 2550 scope.go:117] "RemoveContainer" containerID="a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db" May 25 07:40:04.588889 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588663 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db"} err="failed to get container status \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": rpc error: code = NotFound desc = could not find container \"a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db\": container with ID starting with a4774482d2129775484a5dda60bb54ec8f6007c09a150262f71e6ae00c7a73db not found: ID does not exist" May 25 07:40:04.588889 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588685 2550 scope.go:117] "RemoveContainer" containerID="08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f" May 25 07:40:04.589025 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588924 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f"} err="failed to get container status \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": rpc error: code = NotFound desc = could not find container \"08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f\": container with ID starting with 08e868651240e0d93b0e515fb9b30fd5e4e9ca8c4dbc45aacb527d0673b4be6f not found: ID does not exist" May 25 07:40:04.589025 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.588945 2550 scope.go:117] "RemoveContainer" containerID="33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f" May 25 07:40:04.589205 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.589185 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f"} err="failed to get container status \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": rpc error: code = NotFound desc = could not find container \"33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f\": container with ID starting with 33a49789fd69f59b39aeb7ea86fa6e004c8db71b231e9d9d7e9e06e3af89219f not found: ID does not exist" May 25 07:40:04.589254 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.589207 2550 scope.go:117] "RemoveContainer" containerID="1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c" May 25 07:40:04.589455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.589434 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c"} err="failed to get container status \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": rpc error: code = NotFound desc = could not find container \"1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c\": container with ID starting with 1aa919348f82a3a0be2e75d7aa01f56beebab4b40955a96a181fad71c81e314c not found: ID does not exist" May 25 07:40:04.589530 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.589456 2550 scope.go:117] "RemoveContainer" containerID="0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d" May 25 07:40:04.589630 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.589609 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d"} err="failed to get container status \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": rpc error: code = NotFound desc = could not find container \"0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d\": container with ID starting with 0f0cf6bf5acd7b3a2229832dea2a918fd03577f218383083890300fb70f7067d not found: ID does not exist" May 25 07:40:04.590090 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590074 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:40:04.590400 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590386 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="prometheus" May 25 07:40:04.590437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590401 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="prometheus" May 25 07:40:04.590437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590413 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-thanos" May 25 07:40:04.590437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590419 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-thanos" May 25 07:40:04.590437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590427 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="init-config-reloader" May 25 07:40:04.590437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590432 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="init-config-reloader" May 25 07:40:04.590437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590437 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590443 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590452 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="config-reloader" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590457 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="config-reloader" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590464 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="thanos-sidecar" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590468 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="thanos-sidecar" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590477 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-web" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590481 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-web" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590526 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="config-reloader" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590534 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590539 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-thanos" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590545 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="thanos-sidecar" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590553 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="prometheus" May 25 07:40:04.590607 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.590558 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" containerName="kube-rbac-proxy-web" May 25 07:40:04.595520 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.595504 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.598834 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.598816 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 07:40:04.598933 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.598920 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 07:40:04.599132 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.599109 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 07:40:04.599217 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.599131 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 07:40:04.599542 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.599519 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 07:40:04.599728 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.599536 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 07:40:04.600801 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.600775 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 07:40:04.601110 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.600882 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 07:40:04.601110 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.600903 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 07:40:04.601110 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.600888 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 07:40:04.601110 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.601036 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-84pp16sb7b9rl\"" May 25 07:40:04.601606 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.601589 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 07:40:04.603069 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.603041 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g6tz6\"" May 25 07:40:04.604446 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.604427 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 07:40:04.607036 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.607020 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 07:40:04.614099 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.614075 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:40:04.616889 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616873 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-metrics-client-ca\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616892 2550 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-metrics-client-certs\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616903 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jzkr\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-kube-api-access-6jzkr\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616912 2550 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616922 2550 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-kube-rbac-proxy\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616931 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616939 2550 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-grpc-tls\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616948 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616956 2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-config-out\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.616966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616965 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.617231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616974 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.617231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616983 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-db\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.617231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.616992 2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b444fa4-105b-4202-9fca-b4fc1b358ea4-tls-assets\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.617231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.617000 2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-web-config\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.617231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.617007 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b444fa4-105b-4202-9fca-b4fc1b358ea4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.617231 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.617015 2550 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b444fa4-105b-4202-9fca-b4fc1b358ea4-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:40:04.717763 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717717 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717763 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717762 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwxdw\" (UniqueName: \"kubernetes.io/projected/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-kube-api-access-wwxdw\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717813 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717837 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717866 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717893 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-config\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717906 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717920 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.717993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717934 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.717994 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718045 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718082 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718104 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718157 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718174 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718201 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718190 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.718540 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.718208 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.746825 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.746774 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b444fa4-105b-4202-9fca-b4fc1b358ea4" path="/var/lib/kubelet/pods/0b444fa4-105b-4202-9fca-b4fc1b358ea4/volumes" May 25 07:40:04.818897 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.818856 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819116 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.818909 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819116 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.818930 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819116 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819058 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819116 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819110 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819167 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819198 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819225 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819259 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819289 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819345 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwxdw\" (UniqueName: \"kubernetes.io/projected/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-kube-api-access-wwxdw\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819406 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819430 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819476 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819502 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-config\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819524 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819546 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.819676 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819571 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.820512 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819744 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.820512 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.819888 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.820512 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.820187 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.820682 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.820605 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.822736 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.821973 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.822736 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.822229 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.822736 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.822463 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.822736 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.822692 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.823252 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.822921 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.823585 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.823444 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.823585 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.823530 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.823833 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.823812 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.824013 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.823994 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.824687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.824666 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-config\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.824805 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.824783 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.824875 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.824858 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.825428 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.825411 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.830400 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.830380 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwxdw\" (UniqueName: \"kubernetes.io/projected/8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422-kube-api-access-wwxdw\") pod \"prometheus-k8s-0\" (UID: \"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:04.905957 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:04.905869 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:05.052243 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:05.052210 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 07:40:05.055334 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:40:05.055292 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8b8219_f7ff_45dc_ac28_9e1f4bdf4422.slice/crio-f03254d0b8caa5aa6439b0ebdf6dfc432602e37c2a80ea57e0e4fd3070430463 WatchSource:0}: Error finding container f03254d0b8caa5aa6439b0ebdf6dfc432602e37c2a80ea57e0e4fd3070430463: Status 404 returned error can't find the container with id f03254d0b8caa5aa6439b0ebdf6dfc432602e37c2a80ea57e0e4fd3070430463 May 25 07:40:05.536420 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:05.536383 2550 generic.go:358] "Generic (PLEG): container finished" podID="8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422" containerID="f051fc4e28a8f7947844331ac118df8334328901796253807d67a1ccd010e852" exitCode=0 May 25 07:40:05.536850 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:05.536443 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerDied","Data":"f051fc4e28a8f7947844331ac118df8334328901796253807d67a1ccd010e852"} May 25 07:40:05.536850 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:05.536467 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"f03254d0b8caa5aa6439b0ebdf6dfc432602e37c2a80ea57e0e4fd3070430463"} May 25 07:40:06.538778 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.538738 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:40:06.541339 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.541284 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bfb5b83-eb3f-499f-8643-cbe882eb483b-metrics-certs\") pod \"network-metrics-daemon-mbfkd\" (UID: \"2bfb5b83-eb3f-499f-8643-cbe882eb483b\") " pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:40:06.542832 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.542788 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"f9cd2b1e5f8dd62412efbaf8f5384c0c03d27be9ae8c2d68dcb387d682e09b9c"} May 25 07:40:06.542960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.542841 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"d77eafd7e81175b72dc83428331c8eda1583f60a2482adea63cd70a128ffd8d9"} May 25 07:40:06.542960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.542853 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"cb5221a783e0d4160e4cc5e9d744b96f94d02962e20855492c47bf4cc9a0e04f"} May 25 07:40:06.542960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.542865 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"4467dac0b04780f2c642c0097bd6533c72359c7e291e0d4b4d497c5b83851074"} May 25 07:40:06.542960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.542875 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"205db8c5f32fa485743fc936547abe765d3eef16f9ac6dde82ca6ca568e8b76f"} May 25 07:40:06.542960 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.542886 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422","Type":"ContainerStarted","Data":"0269299fe5596be5b06a8ac32852c9a5732a7cf3bb30d9ad6223b6e4e94c34b4"} May 25 07:40:06.746278 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.746249 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vllxs\"" May 25 07:40:06.753439 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.753418 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbfkd" May 25 07:40:06.884510 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.884451 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.884434281 podStartE2EDuration="2.884434281s" podCreationTimestamp="2026-05-25 07:40:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 07:40:06.580015986 +0000 UTC m=+252.439915608" watchObservedRunningTime="2026-05-25 07:40:06.884434281 +0000 UTC m=+252.744333911" May 25 07:40:06.885198 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:06.885179 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbfkd"] May 25 07:40:06.887609 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:40:06.887581 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfb5b83_eb3f_499f_8643_cbe882eb483b.slice/crio-38bb12edcdaa5f3f4eaf61b86e2ea67cf06e2d0a1960507d35ff234ceab37564 WatchSource:0}: Error finding container 38bb12edcdaa5f3f4eaf61b86e2ea67cf06e2d0a1960507d35ff234ceab37564: Status 404 returned error can't find the container with id 38bb12edcdaa5f3f4eaf61b86e2ea67cf06e2d0a1960507d35ff234ceab37564 May 25 07:40:07.547886 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:07.547842 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbfkd" event={"ID":"2bfb5b83-eb3f-499f-8643-cbe882eb483b","Type":"ContainerStarted","Data":"38bb12edcdaa5f3f4eaf61b86e2ea67cf06e2d0a1960507d35ff234ceab37564"} May 25 07:40:08.553054 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:08.553020 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbfkd" event={"ID":"2bfb5b83-eb3f-499f-8643-cbe882eb483b","Type":"ContainerStarted","Data":"cf17259626a6eeb0f5f2e54b5afb4885fde88db6c82921c6508703844d2795e4"} May 25 07:40:08.553054 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:08.553056 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbfkd" event={"ID":"2bfb5b83-eb3f-499f-8643-cbe882eb483b","Type":"ContainerStarted","Data":"602913809ee9600a8d7e7f15e0108ea506c9fae380f7cdd68cd06188ed734f96"} May 25 07:40:08.624869 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:08.624817 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mbfkd" podStartSLOduration=253.592220286 podStartE2EDuration="4m14.62480221s" podCreationTimestamp="2026-05-25 07:35:54 +0000 UTC" firstStartedPulling="2026-05-25 07:40:06.889498635 +0000 UTC m=+252.749398236" lastFinishedPulling="2026-05-25 07:40:07.922080559 +0000 UTC m=+253.781980160" observedRunningTime="2026-05-25 07:40:08.610961549 +0000 UTC m=+254.470861172" watchObservedRunningTime="2026-05-25 07:40:08.62480221 +0000 UTC m=+254.484701831" May 25 07:40:09.906471 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:09.906433 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:40:54.667909 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:54.667877 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:40:54.668622 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:54.668600 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:40:54.671497 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:40:54.671481 2550 kubelet.go:1628] "Image garbage collection succeeded" May 25 07:41:04.906590 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:41:04.906556 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:41:04.922903 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:41:04.922875 2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:41:05.739033 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:41:05.739006 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 07:42:51.972520 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:51.972487 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-pfn2x"] May 25 07:42:51.975696 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:51.975679 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:51.978839 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:51.978812 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-556sn\"" May 25 07:42:51.979269 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:51.979251 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 25 07:42:51.979812 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:51.979798 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 25 07:42:51.989126 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:51.989103 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-pfn2x"] May 25 07:42:52.147507 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.147463 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c5ds\" (UniqueName: \"kubernetes.io/projected/2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7-kube-api-access-7c5ds\") pod \"cert-manager-79c8d999ff-pfn2x\" (UID: \"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7\") " pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.147692 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.147539 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7-bound-sa-token\") pod \"cert-manager-79c8d999ff-pfn2x\" (UID: \"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7\") " pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.248561 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.248464 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7-bound-sa-token\") pod \"cert-manager-79c8d999ff-pfn2x\" (UID: \"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7\") " pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.248561 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.248523 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c5ds\" (UniqueName: \"kubernetes.io/projected/2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7-kube-api-access-7c5ds\") pod \"cert-manager-79c8d999ff-pfn2x\" (UID: \"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7\") " pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.259358 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.259303 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c5ds\" (UniqueName: \"kubernetes.io/projected/2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7-kube-api-access-7c5ds\") pod \"cert-manager-79c8d999ff-pfn2x\" (UID: \"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7\") " pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.259688 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.259669 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7-bound-sa-token\") pod \"cert-manager-79c8d999ff-pfn2x\" (UID: \"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7\") " pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.297670 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.297623 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-pfn2x" May 25 07:42:52.438437 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.438413 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-pfn2x"] May 25 07:42:52.440744 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:42:52.440720 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2da8bf43_0e87_4ae1_9abd_ebfd22e8a5e7.slice/crio-13de1764367ba95a23147337f475c217adcbc14ba5833fe39a298ccd501676b9 WatchSource:0}: Error finding container 13de1764367ba95a23147337f475c217adcbc14ba5833fe39a298ccd501676b9: Status 404 returned error can't find the container with id 13de1764367ba95a23147337f475c217adcbc14ba5833fe39a298ccd501676b9 May 25 07:42:52.442794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:52.442779 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 07:42:53.049328 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:53.049290 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-pfn2x" event={"ID":"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7","Type":"ContainerStarted","Data":"13de1764367ba95a23147337f475c217adcbc14ba5833fe39a298ccd501676b9"} May 25 07:42:56.060997 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:56.060957 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-pfn2x" event={"ID":"2da8bf43-0e87-4ae1-9abd-ebfd22e8a5e7","Type":"ContainerStarted","Data":"bf5e2ac0b2118c6f8833e3bf246cea9735757248c387ca77639f205232198996"} May 25 07:42:56.085366 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:42:56.085300 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-pfn2x" podStartSLOduration=1.608818482 podStartE2EDuration="5.08528628s" podCreationTimestamp="2026-05-25 07:42:51 +0000 UTC" firstStartedPulling="2026-05-25 07:42:52.442900756 +0000 UTC m=+418.302800361" lastFinishedPulling="2026-05-25 07:42:55.919368555 +0000 UTC m=+421.779268159" observedRunningTime="2026-05-25 07:42:56.08362762 +0000 UTC m=+421.943527244" watchObservedRunningTime="2026-05-25 07:42:56.08528628 +0000 UTC m=+421.945185903" May 25 07:43:07.533936 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.533851 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2"] May 25 07:43:07.537139 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.537122 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.540705 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.540681 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 25 07:43:07.542018 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.541990 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 25 07:43:07.542283 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.542261 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 25 07:43:07.542423 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.542386 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wp85\"" May 25 07:43:07.542517 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.542461 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 25 07:43:07.571450 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.571415 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2"] May 25 07:43:07.580339 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.576980 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2c612ee-77ea-4fe7-98ee-97df2394557e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.580339 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.577100 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c9d4\" (UniqueName: \"kubernetes.io/projected/f2c612ee-77ea-4fe7-98ee-97df2394557e-kube-api-access-4c9d4\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.580339 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.577192 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c612ee-77ea-4fe7-98ee-97df2394557e-webhook-cert\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.678296 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.678264 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2c612ee-77ea-4fe7-98ee-97df2394557e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.678467 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.678341 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9d4\" (UniqueName: \"kubernetes.io/projected/f2c612ee-77ea-4fe7-98ee-97df2394557e-kube-api-access-4c9d4\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.678467 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.678390 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c612ee-77ea-4fe7-98ee-97df2394557e-webhook-cert\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.680849 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.680820 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2c612ee-77ea-4fe7-98ee-97df2394557e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.680965 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.680867 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c612ee-77ea-4fe7-98ee-97df2394557e-webhook-cert\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.687593 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.687556 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c9d4\" (UniqueName: \"kubernetes.io/projected/f2c612ee-77ea-4fe7-98ee-97df2394557e-kube-api-access-4c9d4\") pod \"opendatahub-operator-controller-manager-68ffdd7cdf-jljr2\" (UID: \"f2c612ee-77ea-4fe7-98ee-97df2394557e\") " pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.848812 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.848730 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:07.985411 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:07.985383 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2"] May 25 07:43:07.988370 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:43:07.988336 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c612ee_77ea_4fe7_98ee_97df2394557e.slice/crio-9500d5494e4bab769666bca04d5e6542a65e966303c9ec511979a4fdaafcaa64 WatchSource:0}: Error finding container 9500d5494e4bab769666bca04d5e6542a65e966303c9ec511979a4fdaafcaa64: Status 404 returned error can't find the container with id 9500d5494e4bab769666bca04d5e6542a65e966303c9ec511979a4fdaafcaa64 May 25 07:43:08.099686 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:08.099604 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" event={"ID":"f2c612ee-77ea-4fe7-98ee-97df2394557e","Type":"ContainerStarted","Data":"9500d5494e4bab769666bca04d5e6542a65e966303c9ec511979a4fdaafcaa64"} May 25 07:43:11.113694 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:11.113657 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" event={"ID":"f2c612ee-77ea-4fe7-98ee-97df2394557e","Type":"ContainerStarted","Data":"7af7312e2e71d3630297aacf13c7bdee89fe727f9bd9045e7f1a392ac9dc5c9c"} May 25 07:43:11.114143 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:11.113795 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:11.143751 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:11.143691 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" podStartSLOduration=1.6332023009999999 podStartE2EDuration="4.143669252s" podCreationTimestamp="2026-05-25 07:43:07 +0000 UTC" firstStartedPulling="2026-05-25 07:43:07.990297221 +0000 UTC m=+433.850196822" lastFinishedPulling="2026-05-25 07:43:10.500764172 +0000 UTC m=+436.360663773" observedRunningTime="2026-05-25 07:43:11.141379278 +0000 UTC m=+437.001278902" watchObservedRunningTime="2026-05-25 07:43:11.143669252 +0000 UTC m=+437.003568875" May 25 07:43:22.119637 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:22.119606 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68ffdd7cdf-jljr2" May 25 07:43:28.326246 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.326210 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xffl7"] May 25 07:43:28.331949 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.331912 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:28.334427 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.334390 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 25 07:43:28.334583 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.334561 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4x5nx\"" May 25 07:43:28.340337 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.340292 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xffl7"] May 25 07:43:28.468545 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.468511 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757bv\" (UniqueName: \"kubernetes.io/projected/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-kube-api-access-757bv\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:28.468716 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.468646 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-cert\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:28.569830 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.569789 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-757bv\" (UniqueName: \"kubernetes.io/projected/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-kube-api-access-757bv\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:28.570020 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.569892 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-cert\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:28.570020 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:28.570003 2550 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 25 07:43:28.570134 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:28.570082 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-cert podName:5f93dd28-9f17-4cdd-ba77-f804bafc5a0b nodeName:}" failed. No retries permitted until 2026-05-25 07:43:29.070057556 +0000 UTC m=+454.929957163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-cert") pod "odh-model-controller-858dbf95b8-xffl7" (UID: "5f93dd28-9f17-4cdd-ba77-f804bafc5a0b") : secret "odh-model-controller-webhook-cert" not found May 25 07:43:28.580502 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:28.580433 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-757bv\" (UniqueName: \"kubernetes.io/projected/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-kube-api-access-757bv\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:29.074935 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:29.074886 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-cert\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:29.077509 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:29.077478 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f93dd28-9f17-4cdd-ba77-f804bafc5a0b-cert\") pod \"odh-model-controller-858dbf95b8-xffl7\" (UID: \"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b\") " pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:29.243474 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:29.243440 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:29.378979 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:29.378949 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xffl7"] May 25 07:43:29.381730 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:43:29.381699 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f93dd28_9f17_4cdd_ba77_f804bafc5a0b.slice/crio-c736cb695e9b8653f8991ac6e320659d5627ae96a82aeff433d43d9ae94ab75b WatchSource:0}: Error finding container c736cb695e9b8653f8991ac6e320659d5627ae96a82aeff433d43d9ae94ab75b: Status 404 returned error can't find the container with id c736cb695e9b8653f8991ac6e320659d5627ae96a82aeff433d43d9ae94ab75b May 25 07:43:30.177542 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:30.177490 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" event={"ID":"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b","Type":"ContainerStarted","Data":"c736cb695e9b8653f8991ac6e320659d5627ae96a82aeff433d43d9ae94ab75b"} May 25 07:43:32.186152 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:32.186121 2550 generic.go:358] "Generic (PLEG): container finished" podID="5f93dd28-9f17-4cdd-ba77-f804bafc5a0b" containerID="b01da4aeaa6e24d2adfdb9ca1a352541e1ed3b3f9e498e4ff2cf9f78074aa1ba" exitCode=1 May 25 07:43:32.186578 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:32.186164 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" event={"ID":"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b","Type":"ContainerDied","Data":"b01da4aeaa6e24d2adfdb9ca1a352541e1ed3b3f9e498e4ff2cf9f78074aa1ba"} May 25 07:43:32.186578 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:32.186416 2550 scope.go:117] "RemoveContainer" containerID="b01da4aeaa6e24d2adfdb9ca1a352541e1ed3b3f9e498e4ff2cf9f78074aa1ba" May 25 07:43:33.191979 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:33.191933 2550 generic.go:358] "Generic (PLEG): container finished" podID="5f93dd28-9f17-4cdd-ba77-f804bafc5a0b" containerID="ac939706cc667bba8e4db5ed3e94b543248da295eecb99f9bd17200651a1e4ba" exitCode=1 May 25 07:43:33.192473 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:33.192019 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" event={"ID":"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b","Type":"ContainerDied","Data":"ac939706cc667bba8e4db5ed3e94b543248da295eecb99f9bd17200651a1e4ba"} May 25 07:43:33.192473 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:33.192051 2550 scope.go:117] "RemoveContainer" containerID="b01da4aeaa6e24d2adfdb9ca1a352541e1ed3b3f9e498e4ff2cf9f78074aa1ba" May 25 07:43:33.192473 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:33.192359 2550 scope.go:117] "RemoveContainer" containerID="ac939706cc667bba8e4db5ed3e94b543248da295eecb99f9bd17200651a1e4ba" May 25 07:43:33.192618 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:33.192582 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-xffl7_opendatahub(5f93dd28-9f17-4cdd-ba77-f804bafc5a0b)\"" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" podUID="5f93dd28-9f17-4cdd-ba77-f804bafc5a0b" May 25 07:43:34.185843 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.185807 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5bx2g"] May 25 07:43:34.189062 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.189046 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.191817 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.191768 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dfgkn\"" May 25 07:43:34.191817 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.191770 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 25 07:43:34.202227 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.202202 2550 scope.go:117] "RemoveContainer" containerID="ac939706cc667bba8e4db5ed3e94b543248da295eecb99f9bd17200651a1e4ba" May 25 07:43:34.202541 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:34.202476 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-xffl7_opendatahub(5f93dd28-9f17-4cdd-ba77-f804bafc5a0b)\"" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" podUID="5f93dd28-9f17-4cdd-ba77-f804bafc5a0b" May 25 07:43:34.213234 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.213206 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5bx2g"] May 25 07:43:34.321753 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.321709 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64437d1b-7ee9-464f-9aa3-3284e98ac935-cert\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.321953 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.321798 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddvx\" (UniqueName: \"kubernetes.io/projected/64437d1b-7ee9-464f-9aa3-3284e98ac935-kube-api-access-cddvx\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.422592 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.422555 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cddvx\" (UniqueName: \"kubernetes.io/projected/64437d1b-7ee9-464f-9aa3-3284e98ac935-kube-api-access-cddvx\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.422841 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.422640 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64437d1b-7ee9-464f-9aa3-3284e98ac935-cert\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.422841 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:34.422752 2550 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 25 07:43:34.422841 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:34.422843 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64437d1b-7ee9-464f-9aa3-3284e98ac935-cert podName:64437d1b-7ee9-464f-9aa3-3284e98ac935 nodeName:}" failed. No retries permitted until 2026-05-25 07:43:34.922804916 +0000 UTC m=+460.782704520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/64437d1b-7ee9-464f-9aa3-3284e98ac935-cert") pod "kserve-controller-manager-856948b99f-5bx2g" (UID: "64437d1b-7ee9-464f-9aa3-3284e98ac935") : secret "kserve-webhook-server-cert" not found May 25 07:43:34.434359 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.434329 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddvx\" (UniqueName: \"kubernetes.io/projected/64437d1b-7ee9-464f-9aa3-3284e98ac935-kube-api-access-cddvx\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.928193 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.928164 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64437d1b-7ee9-464f-9aa3-3284e98ac935-cert\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:34.930493 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:34.930461 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64437d1b-7ee9-464f-9aa3-3284e98ac935-cert\") pod \"kserve-controller-manager-856948b99f-5bx2g\" (UID: \"64437d1b-7ee9-464f-9aa3-3284e98ac935\") " pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:35.104972 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:35.104930 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:35.245687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:35.245652 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5bx2g"] May 25 07:43:35.248608 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:43:35.248582 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64437d1b_7ee9_464f_9aa3_3284e98ac935.slice/crio-9fc5aaea53f357830f6b4031af295a720dc5d7fa383cffa3ff5dd73fbc698dcc WatchSource:0}: Error finding container 9fc5aaea53f357830f6b4031af295a720dc5d7fa383cffa3ff5dd73fbc698dcc: Status 404 returned error can't find the container with id 9fc5aaea53f357830f6b4031af295a720dc5d7fa383cffa3ff5dd73fbc698dcc May 25 07:43:36.210782 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.210744 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" event={"ID":"64437d1b-7ee9-464f-9aa3-3284e98ac935","Type":"ContainerStarted","Data":"9fc5aaea53f357830f6b4031af295a720dc5d7fa383cffa3ff5dd73fbc698dcc"} May 25 07:43:36.581294 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.581215 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j"] May 25 07:43:36.584571 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.584545 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.587079 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.587056 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bwk2w\"" May 25 07:43:36.587079 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.587060 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 25 07:43:36.587989 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.587968 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 25 07:43:36.604055 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.604030 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j"] May 25 07:43:36.744899 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.744857 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tls-certs\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.745082 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.744922 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tmp\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.745082 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.745036 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m825x\" (UniqueName: \"kubernetes.io/projected/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-kube-api-access-m825x\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.846505 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.846431 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tls-certs\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.846505 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.846469 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tmp\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.846697 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.846509 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m825x\" (UniqueName: \"kubernetes.io/projected/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-kube-api-access-m825x\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.846697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:36.846577 2550 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 25 07:43:36.846697 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:36.846641 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tls-certs podName:f0bc39ea-94ec-4e8c-ab54-1bf6e780748b nodeName:}" failed. No retries permitted until 2026-05-25 07:43:37.346625093 +0000 UTC m=+463.206524694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tls-certs") pod "kube-auth-proxy-6b5c649449-r9h7j" (UID: "f0bc39ea-94ec-4e8c-ab54-1bf6e780748b") : secret "kube-auth-proxy-tls" not found May 25 07:43:36.848974 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.848946 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tmp\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:36.859749 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:36.859716 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m825x\" (UniqueName: \"kubernetes.io/projected/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-kube-api-access-m825x\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:37.350744 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:37.350703 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tls-certs\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:37.353252 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:37.353232 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bc39ea-94ec-4e8c-ab54-1bf6e780748b-tls-certs\") pod \"kube-auth-proxy-6b5c649449-r9h7j\" (UID: \"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b\") " pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:37.497655 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:37.497613 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" May 25 07:43:37.636376 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:37.636347 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j"] May 25 07:43:37.638740 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:43:37.638704 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bc39ea_94ec_4e8c_ab54_1bf6e780748b.slice/crio-9279bb0f911baff957c22c1c2f9baa460eaecbb6f66ae13ca727adecaf4df401 WatchSource:0}: Error finding container 9279bb0f911baff957c22c1c2f9baa460eaecbb6f66ae13ca727adecaf4df401: Status 404 returned error can't find the container with id 9279bb0f911baff957c22c1c2f9baa460eaecbb6f66ae13ca727adecaf4df401 May 25 07:43:38.222157 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:38.222098 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" event={"ID":"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b","Type":"ContainerStarted","Data":"9279bb0f911baff957c22c1c2f9baa460eaecbb6f66ae13ca727adecaf4df401"} May 25 07:43:39.227750 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:39.227715 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" event={"ID":"64437d1b-7ee9-464f-9aa3-3284e98ac935","Type":"ContainerStarted","Data":"826f9441d9bff370686ae582c016d2d7e9b1648c516421a6d12c3d97b7509ae5"} May 25 07:43:39.228188 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:39.227858 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:43:39.244481 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:39.244430 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:39.244909 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:39.244890 2550 scope.go:117] "RemoveContainer" containerID="ac939706cc667bba8e4db5ed3e94b543248da295eecb99f9bd17200651a1e4ba" May 25 07:43:39.245154 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:43:39.245112 2550 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-xffl7_opendatahub(5f93dd28-9f17-4cdd-ba77-f804bafc5a0b)\"" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" podUID="5f93dd28-9f17-4cdd-ba77-f804bafc5a0b" May 25 07:43:39.249356 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:39.249290 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" podStartSLOduration=1.8125689390000002 podStartE2EDuration="5.24927767s" podCreationTimestamp="2026-05-25 07:43:34 +0000 UTC" firstStartedPulling="2026-05-25 07:43:35.249992073 +0000 UTC m=+461.109891673" lastFinishedPulling="2026-05-25 07:43:38.686700792 +0000 UTC m=+464.546600404" observedRunningTime="2026-05-25 07:43:39.246875861 +0000 UTC m=+465.106775550" watchObservedRunningTime="2026-05-25 07:43:39.24927767 +0000 UTC m=+465.109177291" May 25 07:43:41.237595 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:41.237563 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" event={"ID":"f0bc39ea-94ec-4e8c-ab54-1bf6e780748b","Type":"ContainerStarted","Data":"d0d045a3a4f05c5dd5208faebdc41b246d21da4a6e79fe59de4092b4b915c9ac"} May 25 07:43:41.255073 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:41.255028 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b5c649449-r9h7j" podStartSLOduration=1.9609148749999998 podStartE2EDuration="5.2550116s" podCreationTimestamp="2026-05-25 07:43:36 +0000 UTC" firstStartedPulling="2026-05-25 07:43:37.640722058 +0000 UTC m=+463.500621661" lastFinishedPulling="2026-05-25 07:43:40.934818786 +0000 UTC m=+466.794718386" observedRunningTime="2026-05-25 07:43:41.253972457 +0000 UTC m=+467.113872088" watchObservedRunningTime="2026-05-25 07:43:41.2550116 +0000 UTC m=+467.114911223" May 25 07:43:49.243741 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:49.243709 2550 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:49.244118 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:49.244104 2550 scope.go:117] "RemoveContainer" containerID="ac939706cc667bba8e4db5ed3e94b543248da295eecb99f9bd17200651a1e4ba" May 25 07:43:50.268758 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:50.268720 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" event={"ID":"5f93dd28-9f17-4cdd-ba77-f804bafc5a0b","Type":"ContainerStarted","Data":"d3d10ceb52f48dc77c110767716ffb097502c35af5927d9c8d5b775c235a2999"} May 25 07:43:50.269345 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:50.268964 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:43:50.346606 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:50.346551 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" podStartSLOduration=2.2318408180000002 podStartE2EDuration="22.346535106s" podCreationTimestamp="2026-05-25 07:43:28 +0000 UTC" firstStartedPulling="2026-05-25 07:43:29.383411761 +0000 UTC m=+455.243311376" lastFinishedPulling="2026-05-25 07:43:49.498106063 +0000 UTC m=+475.358005664" observedRunningTime="2026-05-25 07:43:50.340731392 +0000 UTC m=+476.200631014" watchObservedRunningTime="2026-05-25 07:43:50.346535106 +0000 UTC m=+476.206434727" May 25 07:43:53.765915 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.765882 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg"] May 25 07:43:53.769512 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.769492 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:53.778220 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.778198 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pbmtx\"" May 25 07:43:53.778374 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.778198 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 25 07:43:53.778485 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.778472 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 25 07:43:53.797242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.797219 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwbf\" (UniqueName: \"kubernetes.io/projected/71d35048-9b73-47e4-ac0c-e1fe1d1af2a3-kube-api-access-mmwbf\") pod \"servicemesh-operator3-55f49c5f94-pz7pg\" (UID: \"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:53.797409 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.797269 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/71d35048-9b73-47e4-ac0c-e1fe1d1af2a3-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pz7pg\" (UID: \"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:53.807720 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.807696 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg"] May 25 07:43:53.898520 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.898485 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwbf\" (UniqueName: \"kubernetes.io/projected/71d35048-9b73-47e4-ac0c-e1fe1d1af2a3-kube-api-access-mmwbf\") pod \"servicemesh-operator3-55f49c5f94-pz7pg\" (UID: \"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:53.898682 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.898527 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/71d35048-9b73-47e4-ac0c-e1fe1d1af2a3-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pz7pg\" (UID: \"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:53.901063 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.901034 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/71d35048-9b73-47e4-ac0c-e1fe1d1af2a3-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pz7pg\" (UID: \"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:53.917775 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:53.917743 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwbf\" (UniqueName: \"kubernetes.io/projected/71d35048-9b73-47e4-ac0c-e1fe1d1af2a3-kube-api-access-mmwbf\") pod \"servicemesh-operator3-55f49c5f94-pz7pg\" (UID: \"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:54.079681 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:54.079574 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:54.262949 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:54.262856 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg"] May 25 07:43:54.265280 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:43:54.265247 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d35048_9b73_47e4_ac0c_e1fe1d1af2a3.slice/crio-94686a50960c33a48c9e7a31bdf17d4f923ec52d1a1df85587551f751dca8ac7 WatchSource:0}: Error finding container 94686a50960c33a48c9e7a31bdf17d4f923ec52d1a1df85587551f751dca8ac7: Status 404 returned error can't find the container with id 94686a50960c33a48c9e7a31bdf17d4f923ec52d1a1df85587551f751dca8ac7 May 25 07:43:54.284461 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:54.284433 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" event={"ID":"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3","Type":"ContainerStarted","Data":"94686a50960c33a48c9e7a31bdf17d4f923ec52d1a1df85587551f751dca8ac7"} May 25 07:43:57.296705 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:57.296663 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" event={"ID":"71d35048-9b73-47e4-ac0c-e1fe1d1af2a3","Type":"ContainerStarted","Data":"9159fb7191cb800766bcfe479b64bb0b4aae6734cd46b62e19afa62ef773da94"} May 25 07:43:57.297096 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:57.296805 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:43:57.319154 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:43:57.319106 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" podStartSLOduration=1.792700318 podStartE2EDuration="4.319091285s" podCreationTimestamp="2026-05-25 07:43:53 +0000 UTC" firstStartedPulling="2026-05-25 07:43:54.267763291 +0000 UTC m=+480.127662892" lastFinishedPulling="2026-05-25 07:43:56.794154258 +0000 UTC m=+482.654053859" observedRunningTime="2026-05-25 07:43:57.316997385 +0000 UTC m=+483.176897006" watchObservedRunningTime="2026-05-25 07:43:57.319091285 +0000 UTC m=+483.178990907" May 25 07:44:01.274628 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:01.274596 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-xffl7" May 25 07:44:08.301954 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.301925 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pz7pg" May 25 07:44:08.433325 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.433281 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94"] May 25 07:44:08.436858 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.436838 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.439912 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.439892 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 25 07:44:08.440120 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.440109 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 25 07:44:08.440180 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.440155 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rfljq\"" May 25 07:44:08.440521 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.440501 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 25 07:44:08.440672 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.440657 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 25 07:44:08.464146 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.464121 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94"] May 25 07:44:08.532635 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532596 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.532805 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532649 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.532805 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532737 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d110a8d-f7a3-4985-b680-cb19dc197661-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.532805 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532770 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7vv\" (UniqueName: \"kubernetes.io/projected/3d110a8d-f7a3-4985-b680-cb19dc197661-kube-api-access-lk7vv\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.532973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532861 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.532973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532893 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.532973 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.532921 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634262 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634174 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634262 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634223 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d110a8d-f7a3-4985-b680-cb19dc197661-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634262 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634244 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7vv\" (UniqueName: \"kubernetes.io/projected/3d110a8d-f7a3-4985-b680-cb19dc197661-kube-api-access-lk7vv\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634284 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634301 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634331 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634563 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634362 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.634862 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.634838 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.636993 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.636969 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.637102 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.637007 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.637102 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.637081 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d110a8d-f7a3-4985-b680-cb19dc197661-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.637209 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.637185 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.644991 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.644967 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d110a8d-f7a3-4985-b680-cb19dc197661-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.645251 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.645230 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7vv\" (UniqueName: \"kubernetes.io/projected/3d110a8d-f7a3-4985-b680-cb19dc197661-kube-api-access-lk7vv\") pod \"istiod-openshift-gateway-798958bb55-6hj94\" (UID: \"3d110a8d-f7a3-4985-b680-cb19dc197661\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.746568 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.746524 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:08.927756 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:08.927731 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94"] May 25 07:44:08.929865 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:44:08.929831 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d110a8d_f7a3_4985_b680_cb19dc197661.slice/crio-c907392a1ceb539ee942a4bc9f86fcd105af39459c38734dfcce108facc2d128 WatchSource:0}: Error finding container c907392a1ceb539ee942a4bc9f86fcd105af39459c38734dfcce108facc2d128: Status 404 returned error can't find the container with id c907392a1ceb539ee942a4bc9f86fcd105af39459c38734dfcce108facc2d128 May 25 07:44:09.337673 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:09.337629 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" event={"ID":"3d110a8d-f7a3-4985-b680-cb19dc197661","Type":"ContainerStarted","Data":"c907392a1ceb539ee942a4bc9f86fcd105af39459c38734dfcce108facc2d128"} May 25 07:44:10.240423 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:10.240343 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-5bx2g" May 25 07:44:11.562531 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:11.562491 2550 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 25 07:44:11.562941 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:11.562574 2550 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 25 07:44:12.350109 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:12.350074 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" event={"ID":"3d110a8d-f7a3-4985-b680-cb19dc197661","Type":"ContainerStarted","Data":"81d921fe8eaa6d36386fa30a0e5f7bd35aac5150827a2dcb67200ca55b165f43"} May 25 07:44:12.350282 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:12.350225 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:44:12.352002 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:12.351976 2550 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-6hj94 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 25 07:44:12.352131 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:12.352022 2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" podUID="3d110a8d-f7a3-4985-b680-cb19dc197661" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 07:44:12.374833 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:12.374783 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" podStartSLOduration=1.744784272 podStartE2EDuration="4.374766739s" podCreationTimestamp="2026-05-25 07:44:08 +0000 UTC" firstStartedPulling="2026-05-25 07:44:08.932252289 +0000 UTC m=+494.792151889" lastFinishedPulling="2026-05-25 07:44:11.562234756 +0000 UTC m=+497.422134356" observedRunningTime="2026-05-25 07:44:12.372269641 +0000 UTC m=+498.232169263" watchObservedRunningTime="2026-05-25 07:44:12.374766739 +0000 UTC m=+498.234666360" May 25 07:44:13.354663 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:44:13.354628 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6hj94" May 25 07:45:05.901028 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:05.900944 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-97gbp"] May 25 07:45:05.904368 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:05.904350 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:05.907104 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:05.907081 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 25 07:45:05.907215 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:05.907116 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 25 07:45:05.907215 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:05.907171 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-n9hzj\"" May 25 07:45:05.934777 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:05.934744 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-97gbp"] May 25 07:45:06.018474 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:06.018434 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsllb\" (UniqueName: \"kubernetes.io/projected/22bff738-12a2-414f-b952-e618d06988e0-kube-api-access-zsllb\") pod \"authorino-operator-657f44b778-97gbp\" (UID: \"22bff738-12a2-414f-b952-e618d06988e0\") " pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:06.119210 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:06.119173 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsllb\" (UniqueName: \"kubernetes.io/projected/22bff738-12a2-414f-b952-e618d06988e0-kube-api-access-zsllb\") pod \"authorino-operator-657f44b778-97gbp\" (UID: \"22bff738-12a2-414f-b952-e618d06988e0\") " pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:06.128735 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:06.128702 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsllb\" (UniqueName: \"kubernetes.io/projected/22bff738-12a2-414f-b952-e618d06988e0-kube-api-access-zsllb\") pod \"authorino-operator-657f44b778-97gbp\" (UID: \"22bff738-12a2-414f-b952-e618d06988e0\") " pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:06.217497 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:06.217472 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:06.364586 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:06.364560 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-97gbp"] May 25 07:45:06.367052 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:45:06.367021 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bff738_12a2_414f_b952_e618d06988e0.slice/crio-b82742374e9b412a4a45e7118c9df9a832dc4d6973d9d4dc43f2eabf19dec4f3 WatchSource:0}: Error finding container b82742374e9b412a4a45e7118c9df9a832dc4d6973d9d4dc43f2eabf19dec4f3: Status 404 returned error can't find the container with id b82742374e9b412a4a45e7118c9df9a832dc4d6973d9d4dc43f2eabf19dec4f3 May 25 07:45:06.538517 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:06.538434 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" event={"ID":"22bff738-12a2-414f-b952-e618d06988e0","Type":"ContainerStarted","Data":"b82742374e9b412a4a45e7118c9df9a832dc4d6973d9d4dc43f2eabf19dec4f3"} May 25 07:45:09.549003 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:09.548961 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" event={"ID":"22bff738-12a2-414f-b952-e618d06988e0","Type":"ContainerStarted","Data":"65b3b3d7191de55f5ff835ef3350e15077adfb5d9dfb791cb5adecf6832be5ed"} May 25 07:45:09.549423 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:09.549039 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:09.576629 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:09.576583 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" podStartSLOduration=2.351258141 podStartE2EDuration="4.576568411s" podCreationTimestamp="2026-05-25 07:45:05 +0000 UTC" firstStartedPulling="2026-05-25 07:45:06.368731313 +0000 UTC m=+552.228630914" lastFinishedPulling="2026-05-25 07:45:08.594041584 +0000 UTC m=+554.453941184" observedRunningTime="2026-05-25 07:45:09.574699025 +0000 UTC m=+555.434598648" watchObservedRunningTime="2026-05-25 07:45:09.576568411 +0000 UTC m=+555.436468032" May 25 07:45:20.554574 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:20.554540 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-97gbp" May 25 07:45:30.702182 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.702146 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz"] May 25 07:45:30.708595 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.708571 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:30.713266 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.713244 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jwv6l\"" May 25 07:45:30.739463 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.739434 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz"] May 25 07:45:30.841690 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.841649 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sjlt\" (UniqueName: \"kubernetes.io/projected/4a86b489-01a7-4494-b34d-ada49534f196-kube-api-access-8sjlt\") pod \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:30.841888 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.841863 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a86b489-01a7-4494-b34d-ada49534f196-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:30.942808 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.942773 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sjlt\" (UniqueName: \"kubernetes.io/projected/4a86b489-01a7-4494-b34d-ada49534f196-kube-api-access-8sjlt\") pod \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:30.942982 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.942853 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a86b489-01a7-4494-b34d-ada49534f196-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:30.943192 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.943172 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a86b489-01a7-4494-b34d-ada49534f196-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:30.960353 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:30.960257 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sjlt\" (UniqueName: \"kubernetes.io/projected/4a86b489-01a7-4494-b34d-ada49534f196-kube-api-access-8sjlt\") pod \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:31.019296 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.019264 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:31.156552 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.156518 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz"] May 25 07:45:31.159986 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:45:31.159959 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a86b489_01a7_4494_b34d_ada49534f196.slice/crio-3aa9f8cb425f3da04a9fb91b6eb995bc1380f62274130dbcd3ba5dc09b1bf472 WatchSource:0}: Error finding container 3aa9f8cb425f3da04a9fb91b6eb995bc1380f62274130dbcd3ba5dc09b1bf472: Status 404 returned error can't find the container with id 3aa9f8cb425f3da04a9fb91b6eb995bc1380f62274130dbcd3ba5dc09b1bf472 May 25 07:45:31.365592 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.365510 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz"] May 25 07:45:31.377263 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.377223 2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz"] May 25 07:45:31.414707 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.414680 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9"] May 25 07:45:31.420687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.420663 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.451561 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.451527 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9"] May 25 07:45:31.549573 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.549541 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-zc5s9\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.549728 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.549675 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tfrq\" (UniqueName: \"kubernetes.io/projected/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-kube-api-access-8tfrq\") pod \"kuadrant-operator-controller-manager-84b657d985-zc5s9\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.650385 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.650294 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tfrq\" (UniqueName: \"kubernetes.io/projected/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-kube-api-access-8tfrq\") pod \"kuadrant-operator-controller-manager-84b657d985-zc5s9\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.650385 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.650360 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-zc5s9\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.650738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.650719 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-zc5s9\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.660890 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.660865 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tfrq\" (UniqueName: \"kubernetes.io/projected/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-kube-api-access-8tfrq\") pod \"kuadrant-operator-controller-manager-84b657d985-zc5s9\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:31.731813 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:31.731778 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:32.080073 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:32.080036 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9"] May 25 07:45:32.119514 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:45:32.119475 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4b0c4c_7754_4acd_b3e0_04bf78d815c4.slice/crio-21e03fbb1f67647bf302d44376b6334513ff7ade45e92ecd1f0c1e39985c9a3a WatchSource:0}: Error finding container 21e03fbb1f67647bf302d44376b6334513ff7ade45e92ecd1f0c1e39985c9a3a: Status 404 returned error can't find the container with id 21e03fbb1f67647bf302d44376b6334513ff7ade45e92ecd1f0c1e39985c9a3a May 25 07:45:32.641399 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:32.641359 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" event={"ID":"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4","Type":"ContainerStarted","Data":"21e03fbb1f67647bf302d44376b6334513ff7ade45e92ecd1f0c1e39985c9a3a"} May 25 07:45:35.655564 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.655531 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" event={"ID":"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4","Type":"ContainerStarted","Data":"4bf41dec27842825a2fe853f1f6a7fc1779d1c8c377b193d047e03e94343a029"} May 25 07:45:35.655966 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.655604 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:35.656992 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.656967 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" podUID="4a86b489-01a7-4494-b34d-ada49534f196" containerName="manager" containerID="cri-o://0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98" gracePeriod=2 May 25 07:45:35.702636 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.702600 2550 status_manager.go:895] "Failed to get status for pod" podUID="4a86b489-01a7-4494-b34d-ada49534f196" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" err="pods \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" May 25 07:45:35.928774 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.928441 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:35.932557 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.932510 2550 status_manager.go:895] "Failed to get status for pod" podUID="4a86b489-01a7-4494-b34d-ada49534f196" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" err="pods \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" May 25 07:45:35.993242 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.993211 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a86b489-01a7-4494-b34d-ada49534f196-extensions-socket-volume\") pod \"4a86b489-01a7-4494-b34d-ada49534f196\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " May 25 07:45:35.993427 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.993250 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sjlt\" (UniqueName: \"kubernetes.io/projected/4a86b489-01a7-4494-b34d-ada49534f196-kube-api-access-8sjlt\") pod \"4a86b489-01a7-4494-b34d-ada49534f196\" (UID: \"4a86b489-01a7-4494-b34d-ada49534f196\") " May 25 07:45:35.993491 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.993464 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a86b489-01a7-4494-b34d-ada49534f196-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4a86b489-01a7-4494-b34d-ada49534f196" (UID: "4a86b489-01a7-4494-b34d-ada49534f196"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 07:45:35.995542 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:35.995518 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a86b489-01a7-4494-b34d-ada49534f196-kube-api-access-8sjlt" (OuterVolumeSpecName: "kube-api-access-8sjlt") pod "4a86b489-01a7-4494-b34d-ada49534f196" (UID: "4a86b489-01a7-4494-b34d-ada49534f196"). InnerVolumeSpecName "kube-api-access-8sjlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 07:45:36.094974 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.094950 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a86b489-01a7-4494-b34d-ada49534f196-extensions-socket-volume\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:45:36.094974 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.094975 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sjlt\" (UniqueName: \"kubernetes.io/projected/4a86b489-01a7-4494-b34d-ada49534f196-kube-api-access-8sjlt\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:45:36.661818 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.661778 2550 generic.go:358] "Generic (PLEG): container finished" podID="4a86b489-01a7-4494-b34d-ada49534f196" containerID="0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98" exitCode=2 May 25 07:45:36.662215 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.661832 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" May 25 07:45:36.662215 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.661879 2550 scope.go:117] "RemoveContainer" containerID="0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98" May 25 07:45:36.670638 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.670618 2550 scope.go:117] "RemoveContainer" containerID="0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98" May 25 07:45:36.670855 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:45:36.670834 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98\": container with ID starting with 0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98 not found: ID does not exist" containerID="0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98" May 25 07:45:36.670915 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.670868 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98"} err="failed to get container status \"0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98\": rpc error: code = NotFound desc = could not find container \"0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98\": container with ID starting with 0721536ee16638493d11a7154e63f5f752dd7a5c8e85bd8fb6b4988605237c98 not found: ID does not exist" May 25 07:45:36.676051 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.676024 2550 status_manager.go:895] "Failed to get status for pod" podUID="4a86b489-01a7-4494-b34d-ada49534f196" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" err="pods \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" May 25 07:45:36.678398 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.678371 2550 status_manager.go:895] "Failed to get status for pod" podUID="4a86b489-01a7-4494-b34d-ada49534f196" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8f8mz" err="pods \"kuadrant-operator-controller-manager-84b657d985-8f8mz\" is forbidden: User \"system:node:ip-10-0-133-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-15.ec2.internal' and this object" May 25 07:45:36.748482 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:36.748454 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a86b489-01a7-4494-b34d-ada49534f196" path="/var/lib/kubelet/pods/4a86b489-01a7-4494-b34d-ada49534f196/volumes" May 25 07:45:46.664956 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:46.664922 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:46.690900 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:46.690851 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" podStartSLOduration=12.733439589 podStartE2EDuration="15.690836462s" podCreationTimestamp="2026-05-25 07:45:31 +0000 UTC" firstStartedPulling="2026-05-25 07:45:32.122465297 +0000 UTC m=+577.982364900" lastFinishedPulling="2026-05-25 07:45:35.079862158 +0000 UTC m=+580.939761773" observedRunningTime="2026-05-25 07:45:35.699307205 +0000 UTC m=+581.559206842" watchObservedRunningTime="2026-05-25 07:45:46.690836462 +0000 UTC m=+592.550736083" May 25 07:45:54.700188 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:54.700161 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:45:54.700556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:54.700222 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:45:58.627307 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.627262 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9"] May 25 07:45:58.627838 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.627610 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" podUID="7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" containerName="manager" containerID="cri-o://4bf41dec27842825a2fe853f1f6a7fc1779d1c8c377b193d047e03e94343a029" gracePeriod=10 May 25 07:45:58.744099 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.744068 2550 generic.go:358] "Generic (PLEG): container finished" podID="7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" containerID="4bf41dec27842825a2fe853f1f6a7fc1779d1c8c377b193d047e03e94343a029" exitCode=0 May 25 07:45:58.748114 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.748084 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" event={"ID":"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4","Type":"ContainerDied","Data":"4bf41dec27842825a2fe853f1f6a7fc1779d1c8c377b193d047e03e94343a029"} May 25 07:45:58.879487 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.879422 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:58.998255 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.998222 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tfrq\" (UniqueName: \"kubernetes.io/projected/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-kube-api-access-8tfrq\") pod \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " May 25 07:45:58.998466 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.998337 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-extensions-socket-volume\") pod \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\" (UID: \"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4\") " May 25 07:45:58.998620 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:58.998592 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" (UID: "7d4b0c4c-7754-4acd-b3e0-04bf78d815c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 07:45:59.000438 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.000418 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-kube-api-access-8tfrq" (OuterVolumeSpecName: "kube-api-access-8tfrq") pod "7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" (UID: "7d4b0c4c-7754-4acd-b3e0-04bf78d815c4"). InnerVolumeSpecName "kube-api-access-8tfrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 07:45:59.099028 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.098986 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tfrq\" (UniqueName: \"kubernetes.io/projected/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-kube-api-access-8tfrq\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:45:59.099028 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.099027 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4-extensions-socket-volume\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:45:59.748879 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.748850 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" May 25 07:45:59.749256 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.748851 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9" event={"ID":"7d4b0c4c-7754-4acd-b3e0-04bf78d815c4","Type":"ContainerDied","Data":"21e03fbb1f67647bf302d44376b6334513ff7ade45e92ecd1f0c1e39985c9a3a"} May 25 07:45:59.749256 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.748963 2550 scope.go:117] "RemoveContainer" containerID="4bf41dec27842825a2fe853f1f6a7fc1779d1c8c377b193d047e03e94343a029" May 25 07:45:59.776359 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.776327 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9"] May 25 07:45:59.784730 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:45:59.784706 2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zc5s9"] May 25 07:46:00.748006 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:00.747965 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" path="/var/lib/kubelet/pods/7d4b0c4c-7754-4acd-b3e0-04bf78d815c4/volumes" May 25 07:46:19.613120 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613076 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:19.613700 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613651 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a86b489-01a7-4494-b34d-ada49534f196" containerName="manager" May 25 07:46:19.613700 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613671 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a86b489-01a7-4494-b34d-ada49534f196" containerName="manager" May 25 07:46:19.613821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613718 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" containerName="manager" May 25 07:46:19.613821 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613726 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" containerName="manager" May 25 07:46:19.613915 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613821 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a86b489-01a7-4494-b34d-ada49534f196" containerName="manager" May 25 07:46:19.613915 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.613841 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d4b0c4c-7754-4acd-b3e0-04bf78d815c4" containerName="manager" May 25 07:46:19.616608 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.616587 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.619130 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.619101 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 25 07:46:19.619226 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.619114 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-86dsm\"" May 25 07:46:19.624177 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.623973 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:19.688452 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.688420 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d928ae-ab8a-4086-9f27-40140d53b155-config-file\") pod \"limitador-limitador-7d549b5b-l7kmd\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.688617 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.688476 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxf82\" (UniqueName: \"kubernetes.io/projected/26d928ae-ab8a-4086-9f27-40140d53b155-kube-api-access-xxf82\") pod \"limitador-limitador-7d549b5b-l7kmd\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.705584 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.705549 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:19.789505 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.789470 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d928ae-ab8a-4086-9f27-40140d53b155-config-file\") pod \"limitador-limitador-7d549b5b-l7kmd\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.789685 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.789517 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxf82\" (UniqueName: \"kubernetes.io/projected/26d928ae-ab8a-4086-9f27-40140d53b155-kube-api-access-xxf82\") pod \"limitador-limitador-7d549b5b-l7kmd\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.790137 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.790116 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d928ae-ab8a-4086-9f27-40140d53b155-config-file\") pod \"limitador-limitador-7d549b5b-l7kmd\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.798911 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.798887 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxf82\" (UniqueName: \"kubernetes.io/projected/26d928ae-ab8a-4086-9f27-40140d53b155-kube-api-access-xxf82\") pod \"limitador-limitador-7d549b5b-l7kmd\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:19.928514 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:19.928431 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:20.020085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.020048 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:46:20.024518 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.024497 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.030850 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.030802 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:46:20.068556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.068520 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:46:20.073925 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.073901 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:20.076613 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:46:20.076585 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d928ae_ab8a_4086_9f27_40140d53b155.slice/crio-8c112bd8ff1e8e7b1262481437b7e17615a87e9537ec51bd8aa43da75d50dbcd WatchSource:0}: Error finding container 8c112bd8ff1e8e7b1262481437b7e17615a87e9537ec51bd8aa43da75d50dbcd: Status 404 returned error can't find the container with id 8c112bd8ff1e8e7b1262481437b7e17615a87e9537ec51bd8aa43da75d50dbcd May 25 07:46:20.092870 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.092847 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d24a55-d361-4e6a-8dcd-4418bd65b044-config-file\") pod \"limitador-limitador-78c99df468-jf779\" (UID: \"b7d24a55-d361-4e6a-8dcd-4418bd65b044\") " pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.092985 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.092888 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6hj\" (UniqueName: \"kubernetes.io/projected/b7d24a55-d361-4e6a-8dcd-4418bd65b044-kube-api-access-xp6hj\") pod \"limitador-limitador-78c99df468-jf779\" (UID: \"b7d24a55-d361-4e6a-8dcd-4418bd65b044\") " pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.193662 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.193626 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d24a55-d361-4e6a-8dcd-4418bd65b044-config-file\") pod \"limitador-limitador-78c99df468-jf779\" (UID: \"b7d24a55-d361-4e6a-8dcd-4418bd65b044\") " pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.193662 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.193670 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hj\" (UniqueName: \"kubernetes.io/projected/b7d24a55-d361-4e6a-8dcd-4418bd65b044-kube-api-access-xp6hj\") pod \"limitador-limitador-78c99df468-jf779\" (UID: \"b7d24a55-d361-4e6a-8dcd-4418bd65b044\") " pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.194223 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.194204 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d24a55-d361-4e6a-8dcd-4418bd65b044-config-file\") pod \"limitador-limitador-78c99df468-jf779\" (UID: \"b7d24a55-d361-4e6a-8dcd-4418bd65b044\") " pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.203277 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.203242 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6hj\" (UniqueName: \"kubernetes.io/projected/b7d24a55-d361-4e6a-8dcd-4418bd65b044-kube-api-access-xp6hj\") pod \"limitador-limitador-78c99df468-jf779\" (UID: \"b7d24a55-d361-4e6a-8dcd-4418bd65b044\") " pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.337961 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.337920 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:20.474265 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.474233 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:46:20.477061 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:46:20.477030 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d24a55_d361_4e6a_8dcd_4418bd65b044.slice/crio-a0ba6d9cafd6719b60915d7acc8aa9132eba44320f6c319693524ac30ef4a575 WatchSource:0}: Error finding container a0ba6d9cafd6719b60915d7acc8aa9132eba44320f6c319693524ac30ef4a575: Status 404 returned error can't find the container with id a0ba6d9cafd6719b60915d7acc8aa9132eba44320f6c319693524ac30ef4a575 May 25 07:46:20.824983 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.824828 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" event={"ID":"b7d24a55-d361-4e6a-8dcd-4418bd65b044","Type":"ContainerStarted","Data":"a0ba6d9cafd6719b60915d7acc8aa9132eba44320f6c319693524ac30ef4a575"} May 25 07:46:20.826360 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:20.826213 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" event={"ID":"26d928ae-ab8a-4086-9f27-40140d53b155","Type":"ContainerStarted","Data":"8c112bd8ff1e8e7b1262481437b7e17615a87e9537ec51bd8aa43da75d50dbcd"} May 25 07:46:23.840028 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:23.839981 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" event={"ID":"b7d24a55-d361-4e6a-8dcd-4418bd65b044","Type":"ContainerStarted","Data":"163942972ac3d4b4ec4d97a5928d41386f2436a3a1161884115210902e63ac6e"} May 25 07:46:23.840520 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:23.840103 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:23.841391 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:23.841366 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" event={"ID":"26d928ae-ab8a-4086-9f27-40140d53b155","Type":"ContainerStarted","Data":"e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181"} May 25 07:46:23.841588 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:23.841568 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:23.858492 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:23.858445 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" podStartSLOduration=2.242732906 podStartE2EDuration="4.858431069s" podCreationTimestamp="2026-05-25 07:46:19 +0000 UTC" firstStartedPulling="2026-05-25 07:46:20.478985868 +0000 UTC m=+626.338885469" lastFinishedPulling="2026-05-25 07:46:23.094684017 +0000 UTC m=+628.954583632" observedRunningTime="2026-05-25 07:46:23.857039687 +0000 UTC m=+629.716939309" watchObservedRunningTime="2026-05-25 07:46:23.858431069 +0000 UTC m=+629.718330692" May 25 07:46:23.876160 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:23.876113 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" podStartSLOduration=1.867027535 podStartE2EDuration="4.876097188s" podCreationTimestamp="2026-05-25 07:46:19 +0000 UTC" firstStartedPulling="2026-05-25 07:46:20.078497306 +0000 UTC m=+625.938396910" lastFinishedPulling="2026-05-25 07:46:23.087566954 +0000 UTC m=+628.947466563" observedRunningTime="2026-05-25 07:46:23.873261224 +0000 UTC m=+629.733160847" watchObservedRunningTime="2026-05-25 07:46:23.876097188 +0000 UTC m=+629.735996854" May 25 07:46:34.847059 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:34.847031 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:34.847582 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:34.847080 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-jf779" May 25 07:46:34.909657 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:34.909627 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:34.909858 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:34.909835 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" podUID="26d928ae-ab8a-4086-9f27-40140d53b155" containerName="limitador" containerID="cri-o://e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181" gracePeriod=30 May 25 07:46:35.459167 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.459139 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:35.537901 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.537824 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d928ae-ab8a-4086-9f27-40140d53b155-config-file\") pod \"26d928ae-ab8a-4086-9f27-40140d53b155\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " May 25 07:46:35.538055 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.537930 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxf82\" (UniqueName: \"kubernetes.io/projected/26d928ae-ab8a-4086-9f27-40140d53b155-kube-api-access-xxf82\") pod \"26d928ae-ab8a-4086-9f27-40140d53b155\" (UID: \"26d928ae-ab8a-4086-9f27-40140d53b155\") " May 25 07:46:35.538266 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.538239 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d928ae-ab8a-4086-9f27-40140d53b155-config-file" (OuterVolumeSpecName: "config-file") pod "26d928ae-ab8a-4086-9f27-40140d53b155" (UID: "26d928ae-ab8a-4086-9f27-40140d53b155"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 07:46:35.540104 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.540082 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d928ae-ab8a-4086-9f27-40140d53b155-kube-api-access-xxf82" (OuterVolumeSpecName: "kube-api-access-xxf82") pod "26d928ae-ab8a-4086-9f27-40140d53b155" (UID: "26d928ae-ab8a-4086-9f27-40140d53b155"). InnerVolumeSpecName "kube-api-access-xxf82". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 07:46:35.638670 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.638630 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxf82\" (UniqueName: \"kubernetes.io/projected/26d928ae-ab8a-4086-9f27-40140d53b155-kube-api-access-xxf82\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:46:35.638670 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.638665 2550 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d928ae-ab8a-4086-9f27-40140d53b155-config-file\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:46:35.885713 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.885620 2550 generic.go:358] "Generic (PLEG): container finished" podID="26d928ae-ab8a-4086-9f27-40140d53b155" containerID="e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181" exitCode=0 May 25 07:46:35.885713 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.885665 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" event={"ID":"26d928ae-ab8a-4086-9f27-40140d53b155","Type":"ContainerDied","Data":"e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181"} May 25 07:46:35.885713 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.885686 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" May 25 07:46:35.885713 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.885694 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-l7kmd" event={"ID":"26d928ae-ab8a-4086-9f27-40140d53b155","Type":"ContainerDied","Data":"8c112bd8ff1e8e7b1262481437b7e17615a87e9537ec51bd8aa43da75d50dbcd"} May 25 07:46:35.885713 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.885714 2550 scope.go:117] "RemoveContainer" containerID="e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181" May 25 07:46:35.895970 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.895951 2550 scope.go:117] "RemoveContainer" containerID="e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181" May 25 07:46:35.896223 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:46:35.896202 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181\": container with ID starting with e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181 not found: ID does not exist" containerID="e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181" May 25 07:46:35.896292 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.896232 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181"} err="failed to get container status \"e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181\": rpc error: code = NotFound desc = could not find container \"e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181\": container with ID starting with e25644c42c909f3ca039641f41e334edcf6c620e69b42e4a50368fa070646181 not found: ID does not exist" May 25 07:46:35.909362 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.909305 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:35.914076 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:35.914052 2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-l7kmd"] May 25 07:46:36.748651 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:36.748622 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d928ae-ab8a-4086-9f27-40140d53b155" path="/var/lib/kubelet/pods/26d928ae-ab8a-4086-9f27-40140d53b155/volumes" May 25 07:46:38.897274 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.897242 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wkkft"] May 25 07:46:38.897688 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.897674 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d928ae-ab8a-4086-9f27-40140d53b155" containerName="limitador" May 25 07:46:38.897734 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.897690 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d928ae-ab8a-4086-9f27-40140d53b155" containerName="limitador" May 25 07:46:38.897767 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.897755 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="26d928ae-ab8a-4086-9f27-40140d53b155" containerName="limitador" May 25 07:46:38.901961 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.901943 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:38.904724 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.904701 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 25 07:46:38.905194 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.905170 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kcnnc\"" May 25 07:46:38.912248 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.912223 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wkkft"] May 25 07:46:38.968239 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.968197 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7cm9\" (UniqueName: \"kubernetes.io/projected/0b418580-4a7e-4b19-868b-facc470ef82f-kube-api-access-p7cm9\") pod \"postgres-68c4fbbd6f-wkkft\" (UID: \"0b418580-4a7e-4b19-868b-facc470ef82f\") " pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:38.968455 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:38.968285 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b418580-4a7e-4b19-868b-facc470ef82f-data\") pod \"postgres-68c4fbbd6f-wkkft\" (UID: \"0b418580-4a7e-4b19-868b-facc470ef82f\") " pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:39.069255 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.069221 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7cm9\" (UniqueName: \"kubernetes.io/projected/0b418580-4a7e-4b19-868b-facc470ef82f-kube-api-access-p7cm9\") pod \"postgres-68c4fbbd6f-wkkft\" (UID: \"0b418580-4a7e-4b19-868b-facc470ef82f\") " pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:39.069462 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.069286 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b418580-4a7e-4b19-868b-facc470ef82f-data\") pod \"postgres-68c4fbbd6f-wkkft\" (UID: \"0b418580-4a7e-4b19-868b-facc470ef82f\") " pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:39.069644 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.069627 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b418580-4a7e-4b19-868b-facc470ef82f-data\") pod \"postgres-68c4fbbd6f-wkkft\" (UID: \"0b418580-4a7e-4b19-868b-facc470ef82f\") " pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:39.077845 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.077826 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7cm9\" (UniqueName: \"kubernetes.io/projected/0b418580-4a7e-4b19-868b-facc470ef82f-kube-api-access-p7cm9\") pod \"postgres-68c4fbbd6f-wkkft\" (UID: \"0b418580-4a7e-4b19-868b-facc470ef82f\") " pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:39.214479 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.214441 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:39.345498 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.345472 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wkkft"] May 25 07:46:39.347848 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:46:39.347819 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b418580_4a7e_4b19_868b_facc470ef82f.slice/crio-dc5955d66accbfaba5fe37c924f0636a31a44f1c4c0e7fddaa6753a3bbd58ce7 WatchSource:0}: Error finding container dc5955d66accbfaba5fe37c924f0636a31a44f1c4c0e7fddaa6753a3bbd58ce7: Status 404 returned error can't find the container with id dc5955d66accbfaba5fe37c924f0636a31a44f1c4c0e7fddaa6753a3bbd58ce7 May 25 07:46:39.904296 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:39.904261 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wkkft" event={"ID":"0b418580-4a7e-4b19-868b-facc470ef82f","Type":"ContainerStarted","Data":"dc5955d66accbfaba5fe37c924f0636a31a44f1c4c0e7fddaa6753a3bbd58ce7"} May 25 07:46:44.927136 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:44.927100 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wkkft" event={"ID":"0b418580-4a7e-4b19-868b-facc470ef82f","Type":"ContainerStarted","Data":"81206c3d1e0f51426fd25dc8fb339d94607d1bb2cf638e708a181ed47e6cb195"} May 25 07:46:44.927536 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:44.927166 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:44.945015 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:44.944950 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-wkkft" podStartSLOduration=2.164007888 podStartE2EDuration="6.944933856s" podCreationTimestamp="2026-05-25 07:46:38 +0000 UTC" firstStartedPulling="2026-05-25 07:46:39.349538745 +0000 UTC m=+645.209438347" lastFinishedPulling="2026-05-25 07:46:44.130464714 +0000 UTC m=+649.990364315" observedRunningTime="2026-05-25 07:46:44.944153119 +0000 UTC m=+650.804052743" watchObservedRunningTime="2026-05-25 07:46:44.944933856 +0000 UTC m=+650.804833478" May 25 07:46:50.960548 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:50.960515 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-wkkft" May 25 07:46:57.010416 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.010376 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c5699f464-7xtww"] May 25 07:46:57.230487 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.230448 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c5699f464-7xtww"] May 25 07:46:57.230662 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.230577 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:46:57.233941 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.233889 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5tpbv\"" May 25 07:46:57.234049 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.234007 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 25 07:46:57.344508 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.344415 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dxb8\" (UniqueName: \"kubernetes.io/projected/1a3509bd-5710-446b-a270-dfa7b2945057-kube-api-access-2dxb8\") pod \"maas-controller-7c5699f464-7xtww\" (UID: \"1a3509bd-5710-446b-a270-dfa7b2945057\") " pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:46:57.445136 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.445101 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dxb8\" (UniqueName: \"kubernetes.io/projected/1a3509bd-5710-446b-a270-dfa7b2945057-kube-api-access-2dxb8\") pod \"maas-controller-7c5699f464-7xtww\" (UID: \"1a3509bd-5710-446b-a270-dfa7b2945057\") " pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:46:57.454413 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.454379 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dxb8\" (UniqueName: \"kubernetes.io/projected/1a3509bd-5710-446b-a270-dfa7b2945057-kube-api-access-2dxb8\") pod \"maas-controller-7c5699f464-7xtww\" (UID: \"1a3509bd-5710-446b-a270-dfa7b2945057\") " pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:46:57.541444 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.541399 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:46:57.689178 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.689132 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c5699f464-7xtww"] May 25 07:46:57.692997 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:46:57.692964 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3509bd_5710_446b_a270_dfa7b2945057.slice/crio-fb3419c39108a3939eeecc07977470743a3584e3b2b285227f958d7bcc4d57cd WatchSource:0}: Error finding container fb3419c39108a3939eeecc07977470743a3584e3b2b285227f958d7bcc4d57cd: Status 404 returned error can't find the container with id fb3419c39108a3939eeecc07977470743a3584e3b2b285227f958d7bcc4d57cd May 25 07:46:57.976791 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:46:57.976753 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5699f464-7xtww" event={"ID":"1a3509bd-5710-446b-a270-dfa7b2945057","Type":"ContainerStarted","Data":"fb3419c39108a3939eeecc07977470743a3584e3b2b285227f958d7bcc4d57cd"} May 25 07:47:00.989794 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:00.989751 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5699f464-7xtww" event={"ID":"1a3509bd-5710-446b-a270-dfa7b2945057","Type":"ContainerStarted","Data":"c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2"} May 25 07:47:00.990214 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:00.989868 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:47:01.009606 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:01.009542 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7c5699f464-7xtww" podStartSLOduration=2.695264248 podStartE2EDuration="5.009522017s" podCreationTimestamp="2026-05-25 07:46:56 +0000 UTC" firstStartedPulling="2026-05-25 07:46:57.694274095 +0000 UTC m=+663.554173696" lastFinishedPulling="2026-05-25 07:47:00.008531861 +0000 UTC m=+665.868431465" observedRunningTime="2026-05-25 07:47:01.008913159 +0000 UTC m=+666.868812792" watchObservedRunningTime="2026-05-25 07:47:01.009522017 +0000 UTC m=+666.869421642" May 25 07:47:11.920085 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:11.920052 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c5699f464-7xtww"] May 25 07:47:11.920502 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:11.920295 2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7c5699f464-7xtww" podUID="1a3509bd-5710-446b-a270-dfa7b2945057" containerName="manager" containerID="cri-o://c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2" gracePeriod=30 May 25 07:47:11.927050 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:11.927020 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:47:12.175037 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:12.174966 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:47:12.270156 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:12.270123 2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dxb8\" (UniqueName: \"kubernetes.io/projected/1a3509bd-5710-446b-a270-dfa7b2945057-kube-api-access-2dxb8\") pod \"1a3509bd-5710-446b-a270-dfa7b2945057\" (UID: \"1a3509bd-5710-446b-a270-dfa7b2945057\") " May 25 07:47:12.272519 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:12.272483 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3509bd-5710-446b-a270-dfa7b2945057-kube-api-access-2dxb8" (OuterVolumeSpecName: "kube-api-access-2dxb8") pod "1a3509bd-5710-446b-a270-dfa7b2945057" (UID: "1a3509bd-5710-446b-a270-dfa7b2945057"). InnerVolumeSpecName "kube-api-access-2dxb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 07:47:12.371367 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:12.371298 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dxb8\" (UniqueName: \"kubernetes.io/projected/1a3509bd-5710-446b-a270-dfa7b2945057-kube-api-access-2dxb8\") on node \"ip-10-0-133-15.ec2.internal\" DevicePath \"\"" May 25 07:47:13.034687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.034597 2550 generic.go:358] "Generic (PLEG): container finished" podID="1a3509bd-5710-446b-a270-dfa7b2945057" containerID="c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2" exitCode=0 May 25 07:47:13.034687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.034644 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5699f464-7xtww" event={"ID":"1a3509bd-5710-446b-a270-dfa7b2945057","Type":"ContainerDied","Data":"c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2"} May 25 07:47:13.034687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.034670 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5699f464-7xtww" event={"ID":"1a3509bd-5710-446b-a270-dfa7b2945057","Type":"ContainerDied","Data":"fb3419c39108a3939eeecc07977470743a3584e3b2b285227f958d7bcc4d57cd"} May 25 07:47:13.034687 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.034685 2550 scope.go:117] "RemoveContainer" containerID="c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2" May 25 07:47:13.035304 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.034715 2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5699f464-7xtww" May 25 07:47:13.043352 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.043297 2550 scope.go:117] "RemoveContainer" containerID="c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2" May 25 07:47:13.043640 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:47:13.043615 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2\": container with ID starting with c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2 not found: ID does not exist" containerID="c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2" May 25 07:47:13.043716 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.043652 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2"} err="failed to get container status \"c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2\": rpc error: code = NotFound desc = could not find container \"c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2\": container with ID starting with c7b0eab9564f04dd3e32b0305170be00589cb0b627d4b77c90b5b0a09819d0d2 not found: ID does not exist" May 25 07:47:13.053505 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.053472 2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c5699f464-7xtww"] May 25 07:47:13.056761 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:13.056736 2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c5699f464-7xtww"] May 25 07:47:14.748829 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:14.748795 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a3509bd-5710-446b-a270-dfa7b2945057" path="/var/lib/kubelet/pods/1a3509bd-5710-446b-a270-dfa7b2945057/volumes" May 25 07:47:31.167538 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.167500 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8c68987b4-9fkq7"] May 25 07:47:31.168117 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.167905 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3509bd-5710-446b-a270-dfa7b2945057" containerName="manager" May 25 07:47:31.168117 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.167917 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3509bd-5710-446b-a270-dfa7b2945057" containerName="manager" May 25 07:47:31.168117 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.167970 2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a3509bd-5710-446b-a270-dfa7b2945057" containerName="manager" May 25 07:47:31.173752 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.173727 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.176225 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.176194 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 25 07:47:31.183829 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.183802 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8c68987b4-9fkq7"] May 25 07:47:31.249798 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.249761 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eef9cfe-9709-4944-bf80-21ef074634a6-maas-api-tls\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.249979 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.249815 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hplt5\" (UniqueName: \"kubernetes.io/projected/2eef9cfe-9709-4944-bf80-21ef074634a6-kube-api-access-hplt5\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.351334 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.351266 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eef9cfe-9709-4944-bf80-21ef074634a6-maas-api-tls\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.351557 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.351388 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hplt5\" (UniqueName: \"kubernetes.io/projected/2eef9cfe-9709-4944-bf80-21ef074634a6-kube-api-access-hplt5\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.351557 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:47:31.351440 2550 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 25 07:47:31.351557 ip-10-0-133-15 kubenswrapper[2550]: E0525 07:47:31.351528 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eef9cfe-9709-4944-bf80-21ef074634a6-maas-api-tls podName:2eef9cfe-9709-4944-bf80-21ef074634a6 nodeName:}" failed. No retries permitted until 2026-05-25 07:47:31.851501828 +0000 UTC m=+697.711401431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2eef9cfe-9709-4944-bf80-21ef074634a6-maas-api-tls") pod "maas-api-8c68987b4-9fkq7" (UID: "2eef9cfe-9709-4944-bf80-21ef074634a6") : secret "maas-api-serving-cert" not found May 25 07:47:31.364208 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.364165 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hplt5\" (UniqueName: \"kubernetes.io/projected/2eef9cfe-9709-4944-bf80-21ef074634a6-kube-api-access-hplt5\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.827397 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.827360 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:47:31.856181 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.856145 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eef9cfe-9709-4944-bf80-21ef074634a6-maas-api-tls\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:31.858824 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:31.858803 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eef9cfe-9709-4944-bf80-21ef074634a6-maas-api-tls\") pod \"maas-api-8c68987b4-9fkq7\" (UID: \"2eef9cfe-9709-4944-bf80-21ef074634a6\") " pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:32.086470 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:32.086386 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:32.222627 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:32.222600 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8c68987b4-9fkq7"] May 25 07:47:32.225334 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:47:32.225282 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eef9cfe_9709_4944_bf80_21ef074634a6.slice/crio-63a316dda2e1075e4b150a34f85b11e30b374712c0e05efc12cb70fe1cff8b55 WatchSource:0}: Error finding container 63a316dda2e1075e4b150a34f85b11e30b374712c0e05efc12cb70fe1cff8b55: Status 404 returned error can't find the container with id 63a316dda2e1075e4b150a34f85b11e30b374712c0e05efc12cb70fe1cff8b55 May 25 07:47:33.109578 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:33.109467 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8c68987b4-9fkq7" event={"ID":"2eef9cfe-9709-4944-bf80-21ef074634a6","Type":"ContainerStarted","Data":"63a316dda2e1075e4b150a34f85b11e30b374712c0e05efc12cb70fe1cff8b55"} May 25 07:47:34.114402 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:34.114364 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8c68987b4-9fkq7" event={"ID":"2eef9cfe-9709-4944-bf80-21ef074634a6","Type":"ContainerStarted","Data":"c93ff7ad61e6299bbb5e4bdeaa1e9b350f5af4774f81e3da27e293073b909868"} May 25 07:47:34.114803 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:34.114508 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:47:34.132580 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:34.132500 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-8c68987b4-9fkq7" podStartSLOduration=1.71799192 podStartE2EDuration="3.132484732s" podCreationTimestamp="2026-05-25 07:47:31 +0000 UTC" firstStartedPulling="2026-05-25 07:47:32.226437191 +0000 UTC m=+698.086336793" lastFinishedPulling="2026-05-25 07:47:33.64093 +0000 UTC m=+699.500829605" observedRunningTime="2026-05-25 07:47:34.130845717 +0000 UTC m=+699.990745340" watchObservedRunningTime="2026-05-25 07:47:34.132484732 +0000 UTC m=+699.992384372" May 25 07:47:40.124073 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:47:40.124043 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8c68987b4-9fkq7" May 25 07:48:02.325922 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.325881 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6"] May 25 07:48:02.330969 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.330951 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.334003 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.333980 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 25 07:48:02.335166 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.335138 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jcz9c\"" May 25 07:48:02.335288 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.335224 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 25 07:48:02.335288 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.335260 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 25 07:48:02.341257 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.341230 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6"] May 25 07:48:02.445253 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.445215 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxp2m\" (UniqueName: \"kubernetes.io/projected/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-kube-api-access-mxp2m\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.445508 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.445269 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.445508 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.445402 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.445615 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.445503 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.445615 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.445533 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.445615 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.445557 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.546462 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546423 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp2m\" (UniqueName: \"kubernetes.io/projected/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-kube-api-access-mxp2m\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.546643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546474 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.546643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546536 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.546643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546581 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.546643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546603 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.546643 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546626 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.547008 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.546979 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.547097 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.547037 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.547152 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.547102 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.548969 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.548949 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.549185 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.549168 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.559944 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.559920 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxp2m\" (UniqueName: \"kubernetes.io/projected/f8a85ffd-b843-4c15-8cb6-fd2d9c13d420-kube-api-access-mxp2m\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6\" (UID: \"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.642386 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.642282 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:02.797195 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.797170 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6"] May 25 07:48:02.799470 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:48:02.799444 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a85ffd_b843_4c15_8cb6_fd2d9c13d420.slice/crio-c356ee08d910fb5ec0cc530cb65a48dcc8c21e3d934c691ff6c84defafc014ab WatchSource:0}: Error finding container c356ee08d910fb5ec0cc530cb65a48dcc8c21e3d934c691ff6c84defafc014ab: Status 404 returned error can't find the container with id c356ee08d910fb5ec0cc530cb65a48dcc8c21e3d934c691ff6c84defafc014ab May 25 07:48:02.801134 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:02.801118 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 07:48:03.049435 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:03.049403 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:48:03.220110 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:03.220068 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" event={"ID":"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420","Type":"ContainerStarted","Data":"c356ee08d910fb5ec0cc530cb65a48dcc8c21e3d934c691ff6c84defafc014ab"} May 25 07:48:07.138627 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:07.138587 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:48:09.245609 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:09.245572 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" event={"ID":"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420","Type":"ContainerStarted","Data":"8f47273ec59b7e61e34e0c2dd9b0962e7ad090318443461bec2f8a67e83158d7"} May 25 07:48:15.270529 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:15.270492 2550 generic.go:358] "Generic (PLEG): container finished" podID="f8a85ffd-b843-4c15-8cb6-fd2d9c13d420" containerID="8f47273ec59b7e61e34e0c2dd9b0962e7ad090318443461bec2f8a67e83158d7" exitCode=0 May 25 07:48:15.270957 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:15.270569 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" event={"ID":"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420","Type":"ContainerDied","Data":"8f47273ec59b7e61e34e0c2dd9b0962e7ad090318443461bec2f8a67e83158d7"} May 25 07:48:16.342338 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:16.342267 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:48:17.280806 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:17.280742 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" event={"ID":"f8a85ffd-b843-4c15-8cb6-fd2d9c13d420","Type":"ContainerStarted","Data":"368caf98c49490f908035c32880420fd6976d2b2fa9e58099905e2622362315e"} May 25 07:48:17.281041 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:17.281013 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:17.346117 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:17.346039 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" podStartSLOduration=1.600048541 podStartE2EDuration="15.346017578s" podCreationTimestamp="2026-05-25 07:48:02 +0000 UTC" firstStartedPulling="2026-05-25 07:48:02.801248888 +0000 UTC m=+728.661148489" lastFinishedPulling="2026-05-25 07:48:16.547217926 +0000 UTC m=+742.407117526" observedRunningTime="2026-05-25 07:48:17.342353407 +0000 UTC m=+743.202253023" watchObservedRunningTime="2026-05-25 07:48:17.346017578 +0000 UTC m=+743.205917202" May 25 07:48:19.753599 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:19.753560 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:48:21.743733 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.743702 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg"] May 25 07:48:21.748583 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.748560 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.753163 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.753136 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 25 07:48:21.773199 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.773160 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg"] May 25 07:48:21.837596 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.837565 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8772f46d-f8b2-4a09-8e66-fa279676a1e5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.837596 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.837606 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t7px\" (UniqueName: \"kubernetes.io/projected/8772f46d-f8b2-4a09-8e66-fa279676a1e5-kube-api-access-7t7px\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.837804 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.837632 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.837804 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.837686 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.837804 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.837743 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.837804 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.837794 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938259 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938225 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938259 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938264 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938500 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938299 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938500 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938372 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8772f46d-f8b2-4a09-8e66-fa279676a1e5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938500 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938403 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t7px\" (UniqueName: \"kubernetes.io/projected/8772f46d-f8b2-4a09-8e66-fa279676a1e5-kube-api-access-7t7px\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938500 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938437 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938799 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938774 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938859 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938834 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.938859 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.938849 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.940877 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.940851 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8772f46d-f8b2-4a09-8e66-fa279676a1e5-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.941145 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.941127 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8772f46d-f8b2-4a09-8e66-fa279676a1e5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:21.949967 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:21.949943 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t7px\" (UniqueName: \"kubernetes.io/projected/8772f46d-f8b2-4a09-8e66-fa279676a1e5-kube-api-access-7t7px\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-2q4lg\" (UID: \"8772f46d-f8b2-4a09-8e66-fa279676a1e5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:22.059528 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:22.059435 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:22.223588 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:22.223558 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg"] May 25 07:48:22.224795 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:48:22.224767 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8772f46d_f8b2_4a09_8e66_fa279676a1e5.slice/crio-8ca32e67f3785aa6df236d87bb9ac92d25afed0bc1b0eb04b00320c7d031557c WatchSource:0}: Error finding container 8ca32e67f3785aa6df236d87bb9ac92d25afed0bc1b0eb04b00320c7d031557c: Status 404 returned error can't find the container with id 8ca32e67f3785aa6df236d87bb9ac92d25afed0bc1b0eb04b00320c7d031557c May 25 07:48:22.300380 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:22.300348 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" event={"ID":"8772f46d-f8b2-4a09-8e66-fa279676a1e5","Type":"ContainerStarted","Data":"8ca32e67f3785aa6df236d87bb9ac92d25afed0bc1b0eb04b00320c7d031557c"} May 25 07:48:23.135616 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:23.135582 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:48:23.305654 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:23.305613 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" event={"ID":"8772f46d-f8b2-4a09-8e66-fa279676a1e5","Type":"ContainerStarted","Data":"035ee291ad108f75f985ad9c4ee8075c0ab7b6dee3d57b90196521cc67d326d3"} May 25 07:48:28.299184 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:28.299094 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6" May 25 07:48:28.326402 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:28.326366 2550 generic.go:358] "Generic (PLEG): container finished" podID="8772f46d-f8b2-4a09-8e66-fa279676a1e5" containerID="035ee291ad108f75f985ad9c4ee8075c0ab7b6dee3d57b90196521cc67d326d3" exitCode=0 May 25 07:48:28.326562 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:28.326439 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" event={"ID":"8772f46d-f8b2-4a09-8e66-fa279676a1e5","Type":"ContainerDied","Data":"035ee291ad108f75f985ad9c4ee8075c0ab7b6dee3d57b90196521cc67d326d3"} May 25 07:48:29.331983 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:29.331945 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" event={"ID":"8772f46d-f8b2-4a09-8e66-fa279676a1e5","Type":"ContainerStarted","Data":"7ad6791e06c33ea7a103e595c2fbeca4a3ad03fcc3836242cc413110c7ac9b24"} May 25 07:48:29.332417 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:29.332181 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:48:29.366529 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:29.366441 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" podStartSLOduration=8.167530066 podStartE2EDuration="8.366421059s" podCreationTimestamp="2026-05-25 07:48:21 +0000 UTC" firstStartedPulling="2026-05-25 07:48:28.327050511 +0000 UTC m=+754.186950114" lastFinishedPulling="2026-05-25 07:48:28.525941491 +0000 UTC m=+754.385841107" observedRunningTime="2026-05-25 07:48:29.362750243 +0000 UTC m=+755.222649883" watchObservedRunningTime="2026-05-25 07:48:29.366421059 +0000 UTC m=+755.226320683" May 25 07:48:40.348839 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:48:40.348801 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-2q4lg" May 25 07:49:05.003992 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:49:05.003895 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:49:43.434958 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:49:43.434915 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:49:52.542578 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:49:52.542540 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:50:02.310738 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:02.310693 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:50:13.106216 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:13.106177 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:50:21.204289 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:21.204252 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:50:32.004378 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:32.004331 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:50:40.325527 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.325444 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58b76dbcd4-js4ds"] May 25 07:50:40.329286 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.329263 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:40.332131 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.332104 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 25 07:50:40.332264 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.332110 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5tpbv\"" May 25 07:50:40.338498 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.338465 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58b76dbcd4-js4ds"] May 25 07:50:40.423246 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.423208 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfc58\" (UniqueName: \"kubernetes.io/projected/8bdc13d3-cc62-4a6c-bed6-33a64b156e63-kube-api-access-hfc58\") pod \"maas-controller-58b76dbcd4-js4ds\" (UID: \"8bdc13d3-cc62-4a6c-bed6-33a64b156e63\") " pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:40.523934 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.523894 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfc58\" (UniqueName: \"kubernetes.io/projected/8bdc13d3-cc62-4a6c-bed6-33a64b156e63-kube-api-access-hfc58\") pod \"maas-controller-58b76dbcd4-js4ds\" (UID: \"8bdc13d3-cc62-4a6c-bed6-33a64b156e63\") " pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:40.532620 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.532589 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfc58\" (UniqueName: \"kubernetes.io/projected/8bdc13d3-cc62-4a6c-bed6-33a64b156e63-kube-api-access-hfc58\") pod \"maas-controller-58b76dbcd4-js4ds\" (UID: \"8bdc13d3-cc62-4a6c-bed6-33a64b156e63\") " pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:40.663161 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.663067 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:40.804170 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.804134 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58b76dbcd4-js4ds"] May 25 07:50:40.808065 ip-10-0-133-15 kubenswrapper[2550]: W0525 07:50:40.808036 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdc13d3_cc62_4a6c_bed6_33a64b156e63.slice/crio-a78af7fefea78213e059ddf4aaf1fd6d8b9b59b8c766e46729b44e0f23757c4a WatchSource:0}: Error finding container a78af7fefea78213e059ddf4aaf1fd6d8b9b59b8c766e46729b44e0f23757c4a: Status 404 returned error can't find the container with id a78af7fefea78213e059ddf4aaf1fd6d8b9b59b8c766e46729b44e0f23757c4a May 25 07:50:40.821649 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:40.821618 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" event={"ID":"8bdc13d3-cc62-4a6c-bed6-33a64b156e63","Type":"ContainerStarted","Data":"a78af7fefea78213e059ddf4aaf1fd6d8b9b59b8c766e46729b44e0f23757c4a"} May 25 07:50:41.827173 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:41.827127 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" event={"ID":"8bdc13d3-cc62-4a6c-bed6-33a64b156e63","Type":"ContainerStarted","Data":"b89bc24c309adb9d86e9dc84d95a0eb3b9f96c6a65537ad6acb6127db1934886"} May 25 07:50:41.827592 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:41.827275 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:41.846756 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:41.846698 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" podStartSLOduration=1.454095284 podStartE2EDuration="1.846679012s" podCreationTimestamp="2026-05-25 07:50:40 +0000 UTC" firstStartedPulling="2026-05-25 07:50:40.809368089 +0000 UTC m=+886.669267691" lastFinishedPulling="2026-05-25 07:50:41.201951818 +0000 UTC m=+887.061851419" observedRunningTime="2026-05-25 07:50:41.844598641 +0000 UTC m=+887.704498264" watchObservedRunningTime="2026-05-25 07:50:41.846679012 +0000 UTC m=+887.706578659" May 25 07:50:52.836626 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:52.836597 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58b76dbcd4-js4ds" May 25 07:50:54.731011 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:54.730974 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:50:54.732405 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:50:54.732378 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:51:45.998425 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:51:45.998384 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:52:00.612111 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:52:00.612069 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:52:41.205496 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:52:41.205459 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:52:56.904799 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:52:56.904756 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:53:11.999556 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:53:11.999518 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:53:28.903208 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:53:28.903171 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:54:22.907170 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:54:22.907133 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:54:32.798012 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:54:32.797980 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:54:48.506495 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:54:48.506455 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:54:56.898044 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:54:56.898007 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:55:14.601826 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:55:14.601789 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:55:22.698976 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:55:22.698937 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:55:54.759758 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:55:54.759731 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:55:54.767864 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:55:54.767841 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 07:55:55.902443 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:55:55.902401 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:56:03.702398 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:56:03.702362 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:56:12.510015 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:56:12.509974 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:56:20.703599 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:56:20.703560 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:56:29.199089 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:56:29.199054 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:56:45.996686 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:56:45.996650 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:56:59.803446 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:56:59.803409 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:57:46.798931 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:57:46.798893 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:57:51.510324 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:57:51.510284 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:57:59.516348 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:57:59.516298 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:07.506465 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:07.506380 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:17.802469 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:17.802429 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:26.094789 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:26.094754 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:34.108532 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:34.108494 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:39.712058 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:39.712019 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:43.905236 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:43.905200 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:58:52.202926 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:58:52.202889 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:00.711370 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:00.711330 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:10.402501 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:10.402462 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:18.711332 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:18.711287 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:27.807547 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:27.807506 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:35.508994 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:35.508916 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:44.404618 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:44.404578 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 07:59:53.311430 ip-10-0-133-15 kubenswrapper[2550]: I0525 07:59:53.311391 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:00:02.299207 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:00:02.299171 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:00:10.811453 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:00:10.811409 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:00:54.786267 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:00:54.786237 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 08:00:54.795161 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:00:54.795135 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 08:02:28.299917 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:02:28.299871 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:02:33.196357 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:02:33.196237 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:01.124081 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:01.124036 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:07.299006 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:07.298960 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:17.605242 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:17.605204 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:27.706136 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:27.706088 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:36.903655 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:36.903616 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:47.700816 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:47.700782 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:03:56.200118 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:03:56.200084 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:04:06.709895 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:04:06.709813 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:04:15.103606 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:04:15.103567 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:04:26.001711 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:04:26.001674 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:04:35.005919 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:04:35.005880 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:05:07.811796 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:05:07.811758 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:05:50.709645 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:05:50.709610 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:05:54.812137 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:05:54.812106 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 08:05:54.822205 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:05:54.822182 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 08:05:59.643617 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:05:59.643576 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:06:08.814645 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:06:08.814613 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:06:16.413879 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:06:16.413839 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:06:25.532962 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:06:25.532919 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:06:38.809248 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:06:38.809214 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:06:46.607355 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:06:46.607295 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:06:54.905367 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:06:54.905330 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:07:03.822757 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:07:03.822673 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:07:11.704070 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:07:11.704034 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:07:20.900196 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:07:20.900161 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:07:33.303820 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:07:33.303782 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:07:50.713398 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:07:50.713365 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:07:58.701039 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:07:58.701005 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:08:07.702239 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:08:07.702202 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:08:15.996984 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:08:15.996945 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:08:33.905184 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:08:33.905085 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:08:41.205202 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:08:41.205130 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:08:50.506188 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:08:50.506156 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:08:58.606477 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:08:58.606443 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:09:08.203270 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:09:08.203238 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:09:15.803096 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:09:15.803058 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:09:25.314307 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:09:25.314270 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:09:38.398277 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:09:38.398234 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:09:47.401683 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:09:47.401637 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:09:59.615774 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:09:59.615736 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:08.403363 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:08.403237 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:14.904054 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:14.904020 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:20.002011 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:20.001969 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:24.199240 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:24.199197 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:33.210806 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:33.210768 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:49.402229 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:49.402195 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:10:54.841160 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:54.841130 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 08:10:54.854815 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:54.854788 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ndgsk_f84ff5cb-a4b9-4394-bf9d-cbdcf054c974/ovn-acl-logging/0.log" May 25 08:10:58.506822 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:10:58.506785 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:11:06.603572 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:06.603540 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:11:11.904764 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:11.904728 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:11:36.294025 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:36.293919 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:11:48.500327 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:48.500281 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jf779"] May 25 08:11:57.662119 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:57.662089 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5bx2g_64437d1b-7ee9-464f-9aa3-3284e98ac935/manager/0.log" May 25 08:11:57.787104 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:57.787075 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8c68987b4-9fkq7_2eef9cfe-9709-4944-bf80-21ef074634a6/maas-api/0.log" May 25 08:11:58.043883 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:58.043851 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58b76dbcd4-js4ds_8bdc13d3-cc62-4a6c-bed6-33a64b156e63/manager/0.log" May 25 08:11:58.169381 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:58.169344 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xffl7_5f93dd28-9f17-4cdd-ba77-f804bafc5a0b/manager/2.log" May 25 08:11:58.403505 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:58.403423 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68ffdd7cdf-jljr2_f2c612ee-77ea-4fe7-98ee-97df2394557e/manager/0.log" May 25 08:11:58.631815 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:11:58.631784 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wkkft_0b418580-4a7e-4b19-868b-facc470ef82f/postgres/0.log" May 25 08:12:00.046512 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:00.046471 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-97gbp_22bff738-12a2-414f-b952-e618d06988e0/manager/0.log" May 25 08:12:00.637458 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:00.637429 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jf779_b7d24a55-d361-4e6a-8dcd-4418bd65b044/limitador/0.log" May 25 08:12:01.250522 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:01.250484 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6hj94_3d110a8d-f7a3-4985-b680-cb19dc197661/discovery/0.log" May 25 08:12:01.479531 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:01.479499 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5c649449-r9h7j_f0bc39ea-94ec-4e8c-ab54-1bf6e780748b/kube-auth-proxy/0.log" May 25 08:12:01.841839 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:01.841811 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f99b4774-qfczw_d2e4cd46-7c1f-4356-ae55-9932adfd6881/router/0.log" May 25 08:12:02.450989 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:02.450946 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-2q4lg_8772f46d-f8b2-4a09-8e66-fa279676a1e5/storage-initializer/0.log" May 25 08:12:02.459603 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:02.459577 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-2q4lg_8772f46d-f8b2-4a09-8e66-fa279676a1e5/main/0.log" May 25 08:12:02.693225 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:02.693192 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6_f8a85ffd-b843-4c15-8cb6-fd2d9c13d420/main/0.log" May 25 08:12:02.700218 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:02.700169 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-f6fb6_f8a85ffd-b843-4c15-8cb6-fd2d9c13d420/storage-initializer/0.log" May 25 08:12:09.637485 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:09.637448 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4q9cr_ca5ca18c-ef79-4e09-84a7-4775571ce0d0/global-pull-secret-syncer/0.log" May 25 08:12:09.890994 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:09.890904 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zstfl_94e9ead9-8f13-40fc-8f1b-9b13f3e0dc06/konnectivity-agent/0.log" May 25 08:12:09.936012 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:09.935969 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-15.ec2.internal_8ffef0a4855b3f685b4e4bc2683f975e/haproxy/0.log" May 25 08:12:14.244258 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:14.244204 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-97gbp_22bff738-12a2-414f-b952-e618d06988e0/manager/0.log" May 25 08:12:14.490878 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:14.490840 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jf779_b7d24a55-d361-4e6a-8dcd-4418bd65b044/limitador/0.log" May 25 08:12:16.318169 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.318119 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-cvbf9_55f12f9c-a582-4328-b56c-5d18b830c7c8/kube-state-metrics/0.log" May 25 08:12:16.333103 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.333069 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-cvbf9_55f12f9c-a582-4328-b56c-5d18b830c7c8/kube-rbac-proxy-main/0.log" May 25 08:12:16.354864 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.354790 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-cvbf9_55f12f9c-a582-4328-b56c-5d18b830c7c8/kube-rbac-proxy-self/0.log" May 25 08:12:16.505870 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.505832 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jflvj_99584619-73ba-4936-befc-8bd78c1022ea/node-exporter/0.log" May 25 08:12:16.524199 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.524164 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jflvj_99584619-73ba-4936-befc-8bd78c1022ea/kube-rbac-proxy/0.log" May 25 08:12:16.544034 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.544010 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jflvj_99584619-73ba-4936-befc-8bd78c1022ea/init-textfile/0.log" May 25 08:12:16.643859 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.643776 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-5tfsk_2850baa8-65d6-43e2-99b7-a23a97670fc6/kube-rbac-proxy-main/0.log" May 25 08:12:16.673276 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.673249 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-5tfsk_2850baa8-65d6-43e2-99b7-a23a97670fc6/kube-rbac-proxy-self/0.log" May 25 08:12:16.691849 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.691822 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-5tfsk_2850baa8-65d6-43e2-99b7-a23a97670fc6/openshift-state-metrics/0.log" May 25 08:12:16.722245 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.722213 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/prometheus/0.log" May 25 08:12:16.741467 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.741438 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/config-reloader/0.log" May 25 08:12:16.762108 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.762072 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/thanos-sidecar/0.log" May 25 08:12:16.782283 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.782254 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/kube-rbac-proxy-web/0.log" May 25 08:12:16.802435 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.802401 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/kube-rbac-proxy/0.log" May 25 08:12:16.825175 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.825137 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/kube-rbac-proxy-thanos/0.log" May 25 08:12:16.852328 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.852292 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a8b8219-f7ff-45dc-ac28-9e1f4bdf4422/init-config-reloader/0.log" May 25 08:12:16.882741 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.882710 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9h96r_cfdd7292-58d8-491c-8d4c-7db7180795e3/prometheus-operator/0.log" May 25 08:12:16.901303 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.901218 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9h96r_cfdd7292-58d8-491c-8d4c-7db7180795e3/kube-rbac-proxy/0.log" May 25 08:12:16.922677 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:16.922647 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-m2l2v_b6397ec5-d44e-4904-94fd-4927bcb6ec86/prometheus-operator-admission-webhook/0.log" May 25 08:12:17.036631 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:17.036594 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7cb6dd49-9tfqx_31436560-7bfc-4dd5-b4d4-869506095d16/thanos-query/0.log" May 25 08:12:17.065040 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:17.065015 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7cb6dd49-9tfqx_31436560-7bfc-4dd5-b4d4-869506095d16/kube-rbac-proxy-web/0.log" May 25 08:12:17.089393 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:17.089343 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7cb6dd49-9tfqx_31436560-7bfc-4dd5-b4d4-869506095d16/kube-rbac-proxy/0.log" May 25 08:12:17.110976 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:17.110940 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7cb6dd49-9tfqx_31436560-7bfc-4dd5-b4d4-869506095d16/prom-label-proxy/0.log" May 25 08:12:17.134231 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:17.134199 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7cb6dd49-9tfqx_31436560-7bfc-4dd5-b4d4-869506095d16/kube-rbac-proxy-rules/0.log" May 25 08:12:17.156296 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:17.156216 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7cb6dd49-9tfqx_31436560-7bfc-4dd5-b4d4-869506095d16/kube-rbac-proxy-metrics/0.log" May 25 08:12:18.006362 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.006324 2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df"] May 25 08:12:18.010061 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.010028 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.012694 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.012671 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpg7d\"/\"kube-root-ca.crt\"" May 25 08:12:18.012802 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.012746 2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpg7d\"/\"default-dockercfg-98xt8\"" May 25 08:12:18.012802 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.012772 2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpg7d\"/\"openshift-service-ca.crt\"" May 25 08:12:18.018634 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.018613 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df"] May 25 08:12:18.030220 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.030193 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-podres\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.030413 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.030231 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-sys\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.030413 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.030265 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-lib-modules\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.030521 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.030404 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-proc\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.030521 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.030443 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29d5k\" (UniqueName: \"kubernetes.io/projected/634f4011-ce73-44cd-9e09-dc51daefde5d-kube-api-access-29d5k\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131007 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.130946 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-sys\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131214 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131037 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-lib-modules\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131214 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131085 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-sys\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131214 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131105 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-proc\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131214 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131133 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29d5k\" (UniqueName: \"kubernetes.io/projected/634f4011-ce73-44cd-9e09-dc51daefde5d-kube-api-access-29d5k\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131214 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131173 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-proc\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131214 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131196 2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-podres\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131481 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131231 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-lib-modules\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.131481 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.131265 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/634f4011-ce73-44cd-9e09-dc51daefde5d-podres\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.139620 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.139590 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29d5k\" (UniqueName: \"kubernetes.io/projected/634f4011-ce73-44cd-9e09-dc51daefde5d-kube-api-access-29d5k\") pod \"perf-node-gather-daemonset-6b4df\" (UID: \"634f4011-ce73-44cd-9e09-dc51daefde5d\") " pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.321658 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.321562 2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:18.457649 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.457608 2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df"] May 25 08:12:18.460766 ip-10-0-133-15 kubenswrapper[2550]: W0525 08:12:18.460732 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod634f4011_ce73_44cd_9e09_dc51daefde5d.slice/crio-be66b9de9fac74027f71a027ee6015862b981dfd795eccd6e6bff70763894ac6 WatchSource:0}: Error finding container be66b9de9fac74027f71a027ee6015862b981dfd795eccd6e6bff70763894ac6: Status 404 returned error can't find the container with id be66b9de9fac74027f71a027ee6015862b981dfd795eccd6e6bff70763894ac6 May 25 08:12:18.462259 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.462236 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 08:12:18.580537 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:18.580508 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" event={"ID":"634f4011-ce73-44cd-9e09-dc51daefde5d","Type":"ContainerStarted","Data":"be66b9de9fac74027f71a027ee6015862b981dfd795eccd6e6bff70763894ac6"} May 25 08:12:19.585841 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:19.585804 2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" event={"ID":"634f4011-ce73-44cd-9e09-dc51daefde5d","Type":"ContainerStarted","Data":"3dce34125aa1289f5169d0066d64bb4c2080c545d7f885af4caf24f60ac0ab55"} May 25 08:12:19.586233 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:19.585855 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:19.602808 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:19.602749 2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" podStartSLOduration=2.60272813 podStartE2EDuration="2.60272813s" podCreationTimestamp="2026-05-25 08:12:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 08:12:19.601888197 +0000 UTC m=+2185.461787822" watchObservedRunningTime="2026-05-25 08:12:19.60272813 +0000 UTC m=+2185.462627754" May 25 08:12:20.775404 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:20.775370 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k6gm4_35bafe66-39dd-4d27-b26a-1e932b8bda7a/dns/0.log" May 25 08:12:20.795566 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:20.795538 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k6gm4_35bafe66-39dd-4d27-b26a-1e932b8bda7a/kube-rbac-proxy/0.log" May 25 08:12:20.819647 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:20.819612 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bkh7r_70b158ef-eab0-42a1-abce-72214f1af1fa/dns-node-resolver/0.log" May 25 08:12:21.375072 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:21.375034 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bm9w7_870e4d82-295f-4129-afea-b01aea6547c2/node-ca/0.log" May 25 08:12:22.418397 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:22.418363 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6hj94_3d110a8d-f7a3-4985-b680-cb19dc197661/discovery/0.log" May 25 08:12:22.464745 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:22.464719 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5c649449-r9h7j_f0bc39ea-94ec-4e8c-ab54-1bf6e780748b/kube-auth-proxy/0.log" May 25 08:12:22.662473 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:22.662437 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f99b4774-qfczw_d2e4cd46-7c1f-4356-ae55-9932adfd6881/router/0.log" May 25 08:12:23.205194 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:23.205147 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqnbv_5ce80502-5fbd-41a9-b4f2-1b5cafc40eb0/serve-healthcheck-canary/0.log" May 25 08:12:23.797087 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:23.797057 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z486f_268adfe4-7c8a-472e-b539-8c1bc0df25c2/kube-rbac-proxy/0.log" May 25 08:12:23.818237 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:23.818211 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z486f_268adfe4-7c8a-472e-b539-8c1bc0df25c2/exporter/0.log" May 25 08:12:23.838107 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:23.838081 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z486f_268adfe4-7c8a-472e-b539-8c1bc0df25c2/extractor/0.log" May 25 08:12:25.599838 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:25.599811 2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpg7d/perf-node-gather-daemonset-6b4df" May 25 08:12:25.765471 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:25.765437 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5bx2g_64437d1b-7ee9-464f-9aa3-3284e98ac935/manager/0.log" May 25 08:12:25.808128 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:25.808089 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8c68987b4-9fkq7_2eef9cfe-9709-4944-bf80-21ef074634a6/maas-api/0.log" May 25 08:12:25.945739 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:25.945700 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58b76dbcd4-js4ds_8bdc13d3-cc62-4a6c-bed6-33a64b156e63/manager/0.log" May 25 08:12:25.967717 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:25.967686 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xffl7_5f93dd28-9f17-4cdd-ba77-f804bafc5a0b/manager/1.log" May 25 08:12:25.988737 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:25.988705 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xffl7_5f93dd28-9f17-4cdd-ba77-f804bafc5a0b/manager/2.log" May 25 08:12:26.079403 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:26.079367 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68ffdd7cdf-jljr2_f2c612ee-77ea-4fe7-98ee-97df2394557e/manager/0.log" May 25 08:12:26.121511 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:26.121473 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wkkft_0b418580-4a7e-4b19-868b-facc470ef82f/postgres/0.log" May 25 08:12:32.259271 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:32.259229 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kdbz9_c67a9311-7d6d-424a-a104-dfd75b2cada8/kube-storage-version-migrator-operator/1.log" May 25 08:12:32.261042 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:32.261016 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kdbz9_c67a9311-7d6d-424a-a104-dfd75b2cada8/kube-storage-version-migrator-operator/0.log" May 25 08:12:33.319528 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.319403 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/kube-multus-additional-cni-plugins/0.log" May 25 08:12:33.353179 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.353150 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/egress-router-binary-copy/0.log" May 25 08:12:33.386117 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.386070 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/cni-plugins/0.log" May 25 08:12:33.420189 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.420159 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/bond-cni-plugin/0.log" May 25 08:12:33.451252 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.451224 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/routeoverride-cni/0.log" May 25 08:12:33.482167 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.482140 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/whereabouts-cni-bincopy/0.log" May 25 08:12:33.517218 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:33.517191 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9bqcx_4c675f66-7c9b-44db-b7bf-675c5c4c6dbf/whereabouts-cni/0.log" May 25 08:12:34.221707 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:34.221672 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lp8s2_87b484b6-7c8b-4d48-b21d-b5a1397a2e26/kube-multus/0.log" May 25 08:12:34.432461 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:34.432434 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mbfkd_2bfb5b83-eb3f-499f-8643-cbe882eb483b/network-metrics-daemon/0.log" May 25 08:12:34.458741 ip-10-0-133-15 kubenswrapper[2550]: I0525 08:12:34.458713 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mbfkd_2bfb5b83-eb3f-499f-8643-cbe882eb483b/kube-rbac-proxy/0.log"