May 26 19:25:38.852914 ip-10-0-131-212 systemd[1]: Starting Kubernetes Kubelet... May 26 19:25:39.357513 ip-10-0-131-212 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 19:25:39.357513 ip-10-0-131-212 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 19:25:39.357513 ip-10-0-131-212 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 19:25:39.357513 ip-10-0-131-212 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 19:25:39.357513 ip-10-0-131-212 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 19:25:39.359531 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.359442 2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 19:25:39.364636 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364622 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:39.364636 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364636 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364640 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364644 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364647 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364650 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364653 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364656 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364658 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364661 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364664 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364666 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364669 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364671 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364674 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364676 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364684 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364687 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364689 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364692 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364694 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:39.364701 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364697 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364700 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364702 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364705 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364708 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364710 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364713 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364716 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364719 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364722 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364725 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364727 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364730 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364735 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364738 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364741 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364744 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364747 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364750 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:39.365174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364753 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364755 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364758 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364761 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364764 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364766 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364769 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364772 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364774 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364777 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364780 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364782 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364785 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364787 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364789 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364793 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364795 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364798 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364801 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364803 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:39.365668 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364806 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364809 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364811 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364814 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364816 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364820 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364822 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364825 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364828 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364830 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364833 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364836 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364838 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364841 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364844 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364848 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364851 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364854 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364857 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:39.366159 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364860 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364862 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364865 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364867 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364871 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364874 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.364877 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365257 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365263 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365267 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365269 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365272 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365274 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365277 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365280 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365282 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365285 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365288 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365290 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365293 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:39.366688 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365295 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365298 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365300 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365303 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365305 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365308 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365310 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365313 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365315 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365318 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365321 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365324 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365326 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365329 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365331 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365334 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365337 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365339 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365342 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365344 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:39.367164 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365348 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365351 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365353 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365356 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365358 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365361 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365363 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365366 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365368 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365370 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365373 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365375 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365378 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365380 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365382 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365385 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365387 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365390 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365394 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:39.367683 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365397 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365400 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365403 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365405 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365408 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365411 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365413 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365416 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365418 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365420 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365423 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365426 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365429 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365432 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365435 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365438 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365440 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365443 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365445 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365447 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:39.368144 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365450 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365452 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365455 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365457 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365460 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365462 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365465 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365467 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365469 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365472 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365474 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365478 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365482 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.365485 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366474 2572 flags.go:64] FLAG: --address="0.0.0.0" May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366483 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366490 2572 flags.go:64] FLAG: --anonymous-auth="true" May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366499 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366504 2572 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366507 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 19:25:39.368643 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366511 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366516 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366519 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366522 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366525 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366529 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366532 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366535 2572 flags.go:64] FLAG: --cgroup-root="" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366538 2572 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366541 2572 flags.go:64] FLAG: --client-ca-file="" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366543 2572 flags.go:64] FLAG: --cloud-config="" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366546 2572 flags.go:64] FLAG: --cloud-provider="external" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366549 2572 flags.go:64] FLAG: --cluster-dns="[]" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366557 2572 flags.go:64] FLAG: --cluster-domain="" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366560 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366563 2572 flags.go:64] FLAG: --config-dir="" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366566 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366569 2572 flags.go:64] FLAG: --container-log-max-files="5" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366573 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366576 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366579 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366582 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366585 2572 flags.go:64] FLAG: --contention-profiling="false" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366588 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 19:25:39.369133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366591 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366594 2572 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366597 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366601 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366604 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366623 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366627 2572 flags.go:64] FLAG: --enable-load-reader="false" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366630 2572 flags.go:64] FLAG: --enable-server="true" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366633 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366638 2572 flags.go:64] FLAG: --event-burst="100" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366641 2572 flags.go:64] FLAG: --event-qps="50" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366644 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366647 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366650 2572 flags.go:64] FLAG: --eviction-hard="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366654 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366657 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366660 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366663 2572 flags.go:64] FLAG: --eviction-soft="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366665 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366668 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366671 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366674 2572 flags.go:64] FLAG: --experimental-mounter-path="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366677 2572 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366680 2572 flags.go:64] FLAG: --fail-swap-on="true" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366683 2572 flags.go:64] FLAG: --feature-gates="" May 26 19:25:39.369726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366687 2572 flags.go:64] FLAG: --file-check-frequency="20s" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366690 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366693 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366697 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366700 2572 flags.go:64] FLAG: --healthz-port="10248" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366703 2572 flags.go:64] FLAG: --help="false" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366706 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-131-212.ec2.internal" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366709 2572 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366712 2572 flags.go:64] FLAG: --http-check-frequency="20s" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366715 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366719 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366722 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366727 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366730 2572 flags.go:64] FLAG: --image-service-endpoint="" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366733 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366736 2572 flags.go:64] FLAG: --kube-api-burst="100" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366739 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366743 2572 flags.go:64] FLAG: --kube-api-qps="50" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366745 2572 flags.go:64] FLAG: --kube-reserved="" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366748 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366751 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366754 2572 flags.go:64] FLAG: --kubelet-cgroups="" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366757 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366760 2572 flags.go:64] FLAG: --lock-file="" May 26 19:25:39.370380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366763 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366765 2572 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366768 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366774 2572 flags.go:64] FLAG: --log-json-split-stream="false" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366777 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366779 2572 flags.go:64] FLAG: --log-text-split-stream="false" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366782 2572 flags.go:64] FLAG: --logging-format="text" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366785 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366788 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366791 2572 flags.go:64] FLAG: --manifest-url="" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366794 2572 flags.go:64] FLAG: --manifest-url-header="" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366798 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366800 2572 flags.go:64] FLAG: --max-open-files="1000000" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366805 2572 flags.go:64] FLAG: --max-pods="110" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366807 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366810 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366813 2572 flags.go:64] FLAG: --memory-manager-policy="None" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366816 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366819 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366822 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366826 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366834 2572 flags.go:64] FLAG: --node-status-max-images="50" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366836 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366840 2572 flags.go:64] FLAG: --oom-score-adj="-999" May 26 19:25:39.370985 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366843 2572 flags.go:64] FLAG: --pod-cidr="" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366846 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366851 2572 flags.go:64] FLAG: --pod-manifest-path="" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366854 2572 flags.go:64] FLAG: --pod-max-pids="-1" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366857 2572 flags.go:64] FLAG: --pods-per-core="0" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366860 2572 flags.go:64] FLAG: --port="10250" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366863 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366866 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0519d06756194054b" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366869 2572 flags.go:64] FLAG: --qos-reserved="" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366872 2572 flags.go:64] FLAG: --read-only-port="10255" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366875 2572 flags.go:64] FLAG: --register-node="true" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366878 2572 flags.go:64] FLAG: --register-schedulable="true" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366880 2572 flags.go:64] FLAG: --register-with-taints="" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366884 2572 flags.go:64] FLAG: --registry-burst="10" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366886 2572 flags.go:64] FLAG: --registry-qps="5" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366889 2572 flags.go:64] FLAG: --reserved-cpus="" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366892 2572 flags.go:64] FLAG: --reserved-memory="" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366896 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366899 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366902 2572 flags.go:64] FLAG: --rotate-certificates="false" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366905 2572 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366907 2572 flags.go:64] FLAG: --runonce="false" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366910 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366913 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366916 2572 flags.go:64] FLAG: --seccomp-default="false" May 26 19:25:39.371599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366919 2572 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366922 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366925 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366928 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366933 2572 flags.go:64] FLAG: --storage-driver-password="root" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366936 2572 flags.go:64] FLAG: --storage-driver-secure="false" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366939 2572 flags.go:64] FLAG: --storage-driver-table="stats" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366942 2572 flags.go:64] FLAG: --storage-driver-user="root" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366946 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366949 2572 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366952 2572 flags.go:64] FLAG: --system-cgroups="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366955 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366960 2572 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366963 2572 flags.go:64] FLAG: --tls-cert-file="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366965 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366972 2572 flags.go:64] FLAG: --tls-min-version="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366974 2572 flags.go:64] FLAG: --tls-private-key-file="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366977 2572 flags.go:64] FLAG: --topology-manager-policy="none" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366980 2572 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366983 2572 flags.go:64] FLAG: --topology-manager-scope="container" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366986 2572 flags.go:64] FLAG: --v="2" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366990 2572 flags.go:64] FLAG: --version="false" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366994 2572 flags.go:64] FLAG: --vmodule="" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.366998 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.367001 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 19:25:39.372227 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367105 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367109 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367112 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367115 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367118 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367121 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367124 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367126 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367129 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367131 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367140 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367145 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367148 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367151 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367153 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367161 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367164 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367167 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367170 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367172 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:39.372855 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367175 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367177 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367180 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367182 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367185 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367187 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367190 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367192 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367195 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367197 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367200 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367202 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367205 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367207 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367210 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367212 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367215 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367217 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367220 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367223 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:39.373371 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367225 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367231 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367236 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367239 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367241 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367244 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367246 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367249 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367257 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367260 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367262 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367264 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367267 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367269 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367272 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367274 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367276 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367279 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367281 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367284 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:39.373884 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367286 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367290 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367293 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367296 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367298 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367301 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367304 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367306 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367309 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367311 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367314 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367316 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367319 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367321 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367325 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367328 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367330 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367333 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367335 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:39.374584 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367338 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367340 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367347 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367350 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367352 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367355 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.367358 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:39.375285 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.368001 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 19:25:39.376555 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.376536 2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 19:25:39.376555 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.376555 2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376602 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376608 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376627 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376632 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376636 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376639 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:39.376641 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376642 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376646 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376649 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376651 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376654 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376658 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376660 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376663 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376666 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376669 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376671 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376674 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376678 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376683 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376686 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376689 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376692 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376695 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376698 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:39.376820 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376700 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376702 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376705 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376707 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376710 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376713 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376716 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376719 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376722 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376724 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376727 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376730 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376732 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376735 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376737 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376742 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376745 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376748 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376751 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376753 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:39.377277 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376756 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376758 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376761 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376764 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376767 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376769 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376772 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376774 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376777 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376779 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376781 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376784 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376787 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376789 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376792 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376794 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376798 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376801 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376804 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376806 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:39.377775 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376809 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376812 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376815 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376817 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376820 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376822 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376826 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376829 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376831 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376834 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376837 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376840 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376843 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376845 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376848 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376850 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376853 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376856 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376858 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376861 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:39.378267 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376864 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.376869 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376959 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376964 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376967 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376969 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376972 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376974 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.376978 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377002 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377006 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377009 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377012 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377015 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377018 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:39.378773 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377020 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377023 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377026 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377028 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377031 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377034 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377037 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377039 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377042 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377045 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377047 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377050 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377052 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377055 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377057 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377060 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377062 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377065 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377067 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377069 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:39.379147 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377072 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377074 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377077 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377079 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377082 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377084 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377087 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377089 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377092 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377094 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377097 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377099 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377102 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377104 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377107 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377109 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377112 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377115 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377117 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377120 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:39.379764 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377123 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377125 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377128 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377131 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377133 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377136 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377138 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377141 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377143 2572 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377146 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377148 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377150 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377154 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377157 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377160 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377162 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377165 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377167 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377169 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377172 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:39.380248 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377175 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377178 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377180 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377183 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377185 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377188 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377191 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377194 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377196 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377199 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377201 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377204 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:39.377207 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.377211 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 19:25:39.380749 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.378049 2572 server.go:962] "Client rotation is on, will bootstrap in background" May 26 19:25:39.383168 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.383156 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 19:25:39.384305 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.384293 2572 server.go:1019] "Starting client certificate rotation" May 26 19:25:39.384404 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.384388 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 19:25:39.384444 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.384424 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 19:25:39.411738 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.411715 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 19:25:39.415802 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.415777 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 19:25:39.435441 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.435423 2572 log.go:25] "Validated CRI v1 runtime API" May 26 19:25:39.441065 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.441050 2572 log.go:25] "Validated CRI v1 image API" May 26 19:25:39.442791 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.442770 2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 19:25:39.444679 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.444663 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 19:25:39.447199 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.447181 2572 fs.go:135] Filesystem UUIDs: map[5c608bf2-b7e9-436f-aaea-e83d93fcb434:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc3194ed-f246-4697-8f2e-2682ef064e3d:/dev/nvme0n1p3] May 26 19:25:39.447255 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.447200 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 19:25:39.452471 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.452360 2572 manager.go:217] Machine: {Timestamp:2026-05-26 19:25:39.451858049 +0000 UTC m=+0.466601538 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099932 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23dfc3e56bf66ffc5c1097870ff2b2 SystemUUID:ec23dfc3-e56b-f66f-fc5c-1097870ff2b2 BootID:7300537d-2f7f-490a-8fc9-e90442e9bad5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:66:1f:de:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:66:1f:de:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:98:b5:80:d2:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 19:25:39.452471 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.452463 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 19:25:39.452602 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.452582 2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 19:25:39.454664 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.454631 2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 19:25:39.454803 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.454668 2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 19:25:39.454847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.454812 2572 topology_manager.go:138] "Creating topology manager with none policy" May 26 19:25:39.454847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.454820 2572 container_manager_linux.go:306] "Creating device plugin manager" May 26 19:25:39.454847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.454828 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 19:25:39.455747 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.455735 2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 19:25:39.457373 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.457363 2572 state_mem.go:36] "Initialized new in-memory state store" May 26 19:25:39.457490 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.457481 2572 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 19:25:39.460970 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.460951 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-44kj5" May 26 19:25:39.461585 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.461576 2572 kubelet.go:491] "Attempting to sync node with API server" May 26 19:25:39.461636 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.461590 2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 19:25:39.461636 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.461603 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 19:25:39.461636 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.461623 2572 kubelet.go:397] "Adding apiserver pod source" May 26 19:25:39.461636 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.461631 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 19:25:39.462758 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.462745 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 19:25:39.462813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.462764 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 19:25:39.465869 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.465852 2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 19:25:39.467953 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.467939 2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 19:25:39.468399 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468387 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-44kj5" May 26 19:25:39.468839 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468826 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468844 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468850 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468856 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468866 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468874 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468881 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 19:25:39.468886 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468888 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 19:25:39.469059 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468895 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 19:25:39.469059 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468901 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 19:25:39.469059 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.468909 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 19:25:39.469235 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.469227 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 19:25:39.470203 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.470191 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 19:25:39.470203 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.470202 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 19:25:39.473438 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.473423 2572 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 19:25:39.473521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.473457 2572 server.go:1295] "Started kubelet" May 26 19:25:39.474212 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.474188 2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:39.474295 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.474229 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 19:25:39.474295 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.474224 2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 19:25:39.474246 ip-10-0-131-212 systemd[1]: Started Kubernetes Kubelet. May 26 19:25:39.474487 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.474301 2572 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 19:25:39.476031 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.475866 2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 19:25:39.478808 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.478785 2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-212.ec2.internal" not found May 26 19:25:39.479280 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.479265 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:39.480132 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.480115 2572 server.go:317] "Adding debug handlers to kubelet server" May 26 19:25:39.485353 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485334 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 19:25:39.485421 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485352 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 19:25:39.485770 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485492 2572 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 19:25:39.485770 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485506 2572 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 19:25:39.485770 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485590 2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 19:25:39.485770 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485648 2572 reconstruct.go:97] "Volume reconstruction finished" May 26 19:25:39.485770 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485661 2572 reconciler.go:26] "Reconciler: start to sync state" May 26 19:25:39.486028 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.485871 2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 19:25:39.486028 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485966 2572 factory.go:55] Registering systemd factory May 26 19:25:39.486028 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.485979 2572 factory.go:223] Registration of the systemd container factory successfully May 26 19:25:39.486225 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.486205 2572 factory.go:153] Registering CRI-O factory May 26 19:25:39.486225 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.486224 2572 factory.go:223] Registration of the crio container factory successfully May 26 19:25:39.486337 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.486308 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-212.ec2.internal\" not found" May 26 19:25:39.486337 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.486328 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 19:25:39.486437 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.486348 2572 factory.go:103] Registering Raw factory May 26 19:25:39.486437 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.486368 2572 manager.go:1196] Started watching for new ooms in manager May 26 19:25:39.486815 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.486799 2572 manager.go:319] Starting recovery of all containers May 26 19:25:39.488938 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.488916 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:39.492221 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.492205 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-212.ec2.internal\" not found" node="ip-10-0-131-212.ec2.internal" May 26 19:25:39.494212 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.494195 2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-212.ec2.internal" not found May 26 19:25:39.497051 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.497037 2572 manager.go:324] Recovery completed May 26 19:25:39.501450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.501438 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:39.503891 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.503876 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:39.503954 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.503903 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:39.503954 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.503914 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:39.504308 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.504295 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 19:25:39.504363 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.504309 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 19:25:39.504363 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.504328 2572 state_mem.go:36] "Initialized new in-memory state store" May 26 19:25:39.507858 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.507846 2572 policy_none.go:49] "None policy: Start" May 26 19:25:39.507899 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.507862 2572 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 19:25:39.507899 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.507872 2572 state_mem.go:35] "Initializing new in-memory state store" May 26 19:25:39.536224 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536210 2572 manager.go:341] "Starting Device Plugin manager" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.536287 2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536300 2572 server.go:85] "Starting device plugin registration server" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536481 2572 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536494 2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536566 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536659 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.536667 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.537171 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.537207 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-212.ec2.internal\" not found" May 26 19:25:39.561317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.552950 2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-212.ec2.internal" not found May 26 19:25:39.608073 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.607993 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 19:25:39.609209 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.609192 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 19:25:39.609262 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.609220 2572 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 19:25:39.609262 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.609245 2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 19:25:39.609262 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.609254 2572 kubelet.go:2451] "Starting kubelet main sync loop" May 26 19:25:39.609363 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:39.609302 2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 19:25:39.612113 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.612092 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:39.636902 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.636879 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:39.637734 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.637716 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:39.637843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.637750 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:39.637843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.637764 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:39.637843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.637806 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-212.ec2.internal" May 26 19:25:39.647994 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.647970 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-212.ec2.internal" May 26 19:25:39.709459 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.709411 2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal"] May 26 19:25:39.711944 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.711915 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" May 26 19:25:39.712067 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.711915 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.745191 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.745175 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" May 26 19:25:39.749558 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.749545 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.757208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.757193 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 19:25:39.759464 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.759451 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 19:25:39.787329 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.787306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed88b466c3e7296d13af6fa3dbdaf250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"ed88b466c3e7296d13af6fa3dbdaf250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.787420 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.787339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e67b3710d712693834df395e6efd6c96-config\") pod \"kube-apiserver-proxy-ip-10-0-131-212.ec2.internal\" (UID: \"e67b3710d712693834df395e6efd6c96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" May 26 19:25:39.787420 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.787365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed88b466c3e7296d13af6fa3dbdaf250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"ed88b466c3e7296d13af6fa3dbdaf250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.888257 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.888164 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e67b3710d712693834df395e6efd6c96-config\") pod \"kube-apiserver-proxy-ip-10-0-131-212.ec2.internal\" (UID: \"e67b3710d712693834df395e6efd6c96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" May 26 19:25:39.888257 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.888205 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed88b466c3e7296d13af6fa3dbdaf250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"ed88b466c3e7296d13af6fa3dbdaf250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.888257 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.888228 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed88b466c3e7296d13af6fa3dbdaf250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"ed88b466c3e7296d13af6fa3dbdaf250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.888450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.888266 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e67b3710d712693834df395e6efd6c96-config\") pod \"kube-apiserver-proxy-ip-10-0-131-212.ec2.internal\" (UID: \"e67b3710d712693834df395e6efd6c96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" May 26 19:25:39.888450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.888275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed88b466c3e7296d13af6fa3dbdaf250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"ed88b466c3e7296d13af6fa3dbdaf250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:39.888450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:39.888277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed88b466c3e7296d13af6fa3dbdaf250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal\" (UID: \"ed88b466c3e7296d13af6fa3dbdaf250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:40.060463 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.060416 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" May 26 19:25:40.061123 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.061107 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" May 26 19:25:40.385023 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.384993 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 19:25:40.385728 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.385147 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 19:25:40.385728 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.385184 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 19:25:40.385728 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.385184 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 19:25:40.462702 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.462668 2572 apiserver.go:52] "Watching apiserver" May 26 19:25:40.470387 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.470338 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 19:20:39 +0000 UTC" deadline="2028-03-11 03:33:04.303801542 +0000 UTC" May 26 19:25:40.470387 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.470384 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15704h7m23.83342064s" May 26 19:25:40.470729 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.470711 2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 19:25:40.471121 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.471097 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rmlqf","openshift-multus/multus-additional-cni-plugins-l9c8r","openshift-ovn-kubernetes/ovnkube-node-59ptn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7","openshift-image-registry/node-ca-7mw7d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal","openshift-multus/multus-xn9l2","openshift-multus/network-metrics-daemon-94xc5","openshift-network-diagnostics/network-check-target-k9cx8","openshift-network-operator/iptables-alerter-nfrts","kube-system/konnectivity-agent-nn8xm","kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sxbbw"] May 26 19:25:40.473577 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.473556 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.475850 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.475822 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 19:25:40.475947 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.475900 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 19:25:40.476009 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.475954 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.476009 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.475983 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-djll7\"" May 26 19:25:40.478326 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478285 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 19:25:40.478433 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478372 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pff4h\"" May 26 19:25:40.478433 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478400 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 19:25:40.478542 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478473 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 19:25:40.478599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478587 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 19:25:40.478678 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478646 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 19:25:40.478731 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.478647 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.481896 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.481212 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 19:25:40.481896 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.481751 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 19:25:40.481896 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.481890 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 19:25:40.483532 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.483512 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7lnj4\"" May 26 19:25:40.483532 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.483526 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 19:25:40.483710 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.483550 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 19:25:40.483710 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.483564 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.483710 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.483655 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 19:25:40.485552 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.485534 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 19:25:40.486273 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.486251 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 19:25:40.486378 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.486361 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 19:25:40.486422 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.486374 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 19:25:40.486422 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.486250 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jlfr9\"" May 26 19:25:40.486682 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.486664 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.488813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.488795 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xn9l2" May 26 19:25:40.489089 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.489071 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 19:25:40.489369 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.489245 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lpjbr\"" May 26 19:25:40.489369 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.489259 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 19:25:40.489369 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.489338 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 19:25:40.490978 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.490956 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5gmpn\"" May 26 19:25:40.491120 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491055 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:40.491120 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11bc48b0-ed2b-495b-89c9-3dddad119bbb-host\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.491231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-system-cni-dir\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491231 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.491135 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:40.491231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-systemd-units\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491057 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 19:25:40.491231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491425 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-env-overrides\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491425 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-ovnkube-script-lib\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491425 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491425 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-cni-bin\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491425 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491382 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/484408c5-a961-4221-826c-f965be4b0c0d-ovn-node-metrics-cert\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491425 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-sys-fs\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11bc48b0-ed2b-495b-89c9-3dddad119bbb-serviceca\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slss9\" (UniqueName: \"kubernetes.io/projected/11bc48b0-ed2b-495b-89c9-3dddad119bbb-kube-api-access-slss9\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-run-netns\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-systemd\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-os-release\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491592 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-kubelet\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-etc-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt7bz\" (UniqueName: \"kubernetes.io/projected/9981d3b7-819a-4992-8268-264375709664-kube-api-access-tt7bz\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cnibin\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-node-log\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-log-socket\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-registration-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9981d3b7-819a-4992-8268-264375709664-hosts-file\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.491893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9981d3b7-819a-4992-8268-264375709664-tmp-dir\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-824xz\" (UniqueName: \"kubernetes.io/projected/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-kube-api-access-824xz\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-slash\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-var-lib-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.491981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-ovn\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-ovnkube-config\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492051 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-cni-netd\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq25f\" (UniqueName: \"kubernetes.io/projected/484408c5-a961-4221-826c-f965be4b0c0d-kube-api-access-lq25f\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-socket-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-device-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-etc-selinux\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.492354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.492216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4n9\" (UniqueName: \"kubernetes.io/projected/3785e335-a9d9-442d-a2c7-e2e02b756f67-kube-api-access-qc4n9\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.493255 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.493236 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:40.493326 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.493306 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:40.495821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.495803 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.497888 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.497868 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 19:25:40.498003 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.497987 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.498417 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.498397 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 19:25:40.498504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.498426 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lgx9m\"" May 26 19:25:40.498504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.498452 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 19:25:40.498504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.498463 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 19:25:40.500315 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.500300 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.500908 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.500888 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 19:25:40.500995 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.500888 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 19:25:40.501123 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.501105 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k9wkb\"" May 26 19:25:40.502696 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.502675 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 19:25:40.502809 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.502699 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 19:25:40.503082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.503063 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n4t4n\"" May 26 19:25:40.520096 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.520077 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h69bv" May 26 19:25:40.527039 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.527022 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h69bv" May 26 19:25:40.586988 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.586965 2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 19:25:40.592730 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-tmp\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.592828 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7glc\" (UniqueName: \"kubernetes.io/projected/7577541e-b896-4245-952d-678b254cb153-kube-api-access-p7glc\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:40.592828 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592762 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.592828 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592779 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.592980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592840 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-etc-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.592980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-cni-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.592980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-etc-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.592980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-host\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.592980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592961 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tt7bz\" (UniqueName: \"kubernetes.io/projected/9981d3b7-819a-4992-8268-264375709664-kube-api-access-tt7bz\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.592987 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-log-socket\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-conf-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-systemd\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593061 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9981d3b7-819a-4992-8268-264375709664-hosts-file\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593075 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-log-socket\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593085 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-slash\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593130 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-ovn\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-slash\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593186 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593155 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9981d3b7-819a-4992-8268-264375709664-hosts-file\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.593208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593199 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-ovn\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593223 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lq25f\" (UniqueName: \"kubernetes.io/projected/484408c5-a961-4221-826c-f965be4b0c0d-kube-api-access-lq25f\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-daemon-config\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzjh2\" (UniqueName: \"kubernetes.io/projected/4cd3c417-c859-4c08-b601-ca2df4626cc0-kube-api-access-zzjh2\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e475e731-9bc9-4a81-a8ce-e834104aa6be-agent-certs\") pod \"konnectivity-agent-nn8xm\" (UID: \"e475e731-9bc9-4a81-a8ce-e834104aa6be\") " pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593333 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593363 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-cni-netd\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593366 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593389 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-socket-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593430 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysconfig\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593431 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-cni-netd\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-os-release\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593487 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-socket-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593518 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-ovnkube-script-lib\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593537 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.593675 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-hostroot\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-multus-certs\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593594 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-lib-modules\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-tuned\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593665 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593693 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/484408c5-a961-4221-826c-f965be4b0c0d-ovn-node-metrics-cert\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593719 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-sys-fs\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-k8s-cni-cncf-io\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cd3c417-c859-4c08-b601-ca2df4626cc0-iptables-alerter-script\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-sys-fs\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cd3c417-c859-4c08-b601-ca2df4626cc0-host-slash\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysctl-conf\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593893 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11bc48b0-ed2b-495b-89c9-3dddad119bbb-serviceca\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593919 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slss9\" (UniqueName: \"kubernetes.io/projected/11bc48b0-ed2b-495b-89c9-3dddad119bbb-kube-api-access-slss9\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.593944 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-run-netns\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594023 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-ovnkube-script-lib\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.594362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594040 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-system-cni-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-cni-bin\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594162 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-kubernetes\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594181 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-os-release\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594204 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594245 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-run-netns\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594237 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-kubelet\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-cni-multus\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594318 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-kubelet\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-var-lib-kubelet\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11bc48b0-ed2b-495b-89c9-3dddad119bbb-serviceca\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-os-release\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-kubelet\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594382 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cnibin\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594425 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cnibin\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594455 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-node-log\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594479 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-registration-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594497 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594500 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-node-log\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-socket-dir-parent\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-modprobe-d\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-registration-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594579 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9981d3b7-819a-4992-8268-264375709664-tmp-dir\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594603 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-824xz\" (UniqueName: \"kubernetes.io/projected/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-kube-api-access-824xz\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594674 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-var-lib-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594706 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-var-lib-openvswitch\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594740 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-ovnkube-config\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594763 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-device-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9981d3b7-819a-4992-8268-264375709664-tmp-dir\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594909 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4n9\" (UniqueName: \"kubernetes.io/projected/3785e335-a9d9-442d-a2c7-e2e02b756f67-kube-api-access-qc4n9\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-cnibin\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.595873 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.594983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595011 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-etc-selinux\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-netns\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pht4m\" (UniqueName: \"kubernetes.io/projected/59054940-d2d1-464d-a08b-3586cb3d21aa-kube-api-access-pht4m\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e475e731-9bc9-4a81-a8ce-e834104aa6be-konnectivity-ca\") pod \"konnectivity-agent-nn8xm\" (UID: \"e475e731-9bc9-4a81-a8ce-e834104aa6be\") " pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595124 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11bc48b0-ed2b-495b-89c9-3dddad119bbb-host\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-sys\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595180 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-system-cni-dir\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595210 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-ovnkube-config\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595266 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-systemd-units\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595265 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-device-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595213 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-systemd-units\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-etc-selinux\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595505 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11bc48b0-ed2b-495b-89c9-3dddad119bbb-host\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595507 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-system-cni-dir\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595534 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-env-overrides\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-etc-kubernetes\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.596598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-run\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxrvf\" (UniqueName: \"kubernetes.io/projected/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-kube-api-access-hxrvf\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595757 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-cni-bin\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595802 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59054940-d2d1-464d-a08b-3586cb3d21aa-cni-binary-copy\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595869 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-systemd\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysctl-d\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.595934 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-host-cni-bin\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.596036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3785e335-a9d9-442d-a2c7-e2e02b756f67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.596054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/484408c5-a961-4221-826c-f965be4b0c0d-run-systemd\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.596086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/484408c5-a961-4221-826c-f965be4b0c0d-env-overrides\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.596165 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded88b466c3e7296d13af6fa3dbdaf250.slice/crio-46976c3385ce16ff82b6ac86aa18478fb0b8fe8a9c0a3fa020e0db641e9a5b2e WatchSource:0}: Error finding container 46976c3385ce16ff82b6ac86aa18478fb0b8fe8a9c0a3fa020e0db641e9a5b2e: Status 404 returned error can't find the container with id 46976c3385ce16ff82b6ac86aa18478fb0b8fe8a9c0a3fa020e0db641e9a5b2e May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.596376 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67b3710d712693834df395e6efd6c96.slice/crio-c952b2f62c4763ac35c67f16ace801bf7db36ae28daadb180d578cde30364f00 WatchSource:0}: Error finding container c952b2f62c4763ac35c67f16ace801bf7db36ae28daadb180d578cde30364f00: Status 404 returned error can't find the container with id c952b2f62c4763ac35c67f16ace801bf7db36ae28daadb180d578cde30364f00 May 26 19:25:40.597245 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.596708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/484408c5-a961-4221-826c-f965be4b0c0d-ovn-node-metrics-cert\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.601292 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.601277 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:25:40.605755 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.603905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt7bz\" (UniqueName: \"kubernetes.io/projected/9981d3b7-819a-4992-8268-264375709664-kube-api-access-tt7bz\") pod \"node-resolver-rmlqf\" (UID: \"9981d3b7-819a-4992-8268-264375709664\") " pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.605755 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.605453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slss9\" (UniqueName: \"kubernetes.io/projected/11bc48b0-ed2b-495b-89c9-3dddad119bbb-kube-api-access-slss9\") pod \"node-ca-7mw7d\" (UID: \"11bc48b0-ed2b-495b-89c9-3dddad119bbb\") " pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.605755 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.605656 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-824xz\" (UniqueName: \"kubernetes.io/projected/d660a004-bccd-4c8a-8bf9-6b14fd8e8240-kube-api-access-824xz\") pod \"multus-additional-cni-plugins-l9c8r\" (UID: \"d660a004-bccd-4c8a-8bf9-6b14fd8e8240\") " pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.605755 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.605709 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq25f\" (UniqueName: \"kubernetes.io/projected/484408c5-a961-4221-826c-f965be4b0c0d-kube-api-access-lq25f\") pod \"ovnkube-node-59ptn\" (UID: \"484408c5-a961-4221-826c-f965be4b0c0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.605987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.605760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4n9\" (UniqueName: \"kubernetes.io/projected/3785e335-a9d9-442d-a2c7-e2e02b756f67-kube-api-access-qc4n9\") pod \"aws-ebs-csi-driver-node-7g8f7\" (UID: \"3785e335-a9d9-442d-a2c7-e2e02b756f67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.612837 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.612796 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" event={"ID":"e67b3710d712693834df395e6efd6c96","Type":"ContainerStarted","Data":"c952b2f62c4763ac35c67f16ace801bf7db36ae28daadb180d578cde30364f00"} May 26 19:25:40.613587 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.613567 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"ed88b466c3e7296d13af6fa3dbdaf250","Type":"ContainerStarted","Data":"46976c3385ce16ff82b6ac86aa18478fb0b8fe8a9c0a3fa020e0db641e9a5b2e"} May 26 19:25:40.696666 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696634 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-conf-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696676 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-systemd\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696700 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-daemon-config\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696723 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzjh2\" (UniqueName: \"kubernetes.io/projected/4cd3c417-c859-4c08-b601-ca2df4626cc0-kube-api-access-zzjh2\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696745 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e475e731-9bc9-4a81-a8ce-e834104aa6be-agent-certs\") pod \"konnectivity-agent-nn8xm\" (UID: \"e475e731-9bc9-4a81-a8ce-e834104aa6be\") " pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-conf-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696754 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-systemd\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696769 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysconfig\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.696821 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696806 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-os-release\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696829 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-hostroot\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696851 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-multus-certs\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696857 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysconfig\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696874 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-lib-modules\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696930 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-os-release\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696926 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-hostroot\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-multus-certs\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696957 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-tuned\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.696997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-lib-modules\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697006 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-k8s-cni-cncf-io\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697034 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cd3c417-c859-4c08-b601-ca2df4626cc0-iptables-alerter-script\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697058 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cd3c417-c859-4c08-b601-ca2df4626cc0-host-slash\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697082 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysctl-conf\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697089 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-k8s-cni-cncf-io\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697110 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-system-cni-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697121 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cd3c417-c859-4c08-b601-ca2df4626cc0-host-slash\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697135 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-cni-bin\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.697239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697158 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-kubernetes\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697176 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-system-cni-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697188 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-cni-multus\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697212 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-var-lib-kubelet\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-cni-bin\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697236 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-kubelet\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysctl-conf\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-cni-multus\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697272 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-socket-dir-parent\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697296 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-kubernetes\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-var-lib-kubelet\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697321 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-modprobe-d\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697323 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-daemon-config\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697340 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-var-lib-kubelet\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697355 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-socket-dir-parent\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697373 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-cnibin\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697401 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-cnibin\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697432 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-modprobe-d\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697426 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-netns\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697460 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-host-run-netns\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697487 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pht4m\" (UniqueName: \"kubernetes.io/projected/59054940-d2d1-464d-a08b-3586cb3d21aa-kube-api-access-pht4m\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697515 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e475e731-9bc9-4a81-a8ce-e834104aa6be-konnectivity-ca\") pod \"konnectivity-agent-nn8xm\" (UID: \"e475e731-9bc9-4a81-a8ce-e834104aa6be\") " pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.697524 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697540 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-sys\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697568 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-etc-kubernetes\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cd3c417-c859-4c08-b601-ca2df4626cc0-iptables-alerter-script\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.697610 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:41.197578605 +0000 UTC m=+2.212322093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-etc-kubernetes\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-sys\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697649 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-run\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697683 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxrvf\" (UniqueName: \"kubernetes.io/projected/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-kube-api-access-hxrvf\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697688 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-run\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697710 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697738 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59054940-d2d1-464d-a08b-3586cb3d21aa-cni-binary-copy\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697773 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysctl-d\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.698569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697822 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-tmp\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697846 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7glc\" (UniqueName: \"kubernetes.io/projected/7577541e-b896-4245-952d-678b254cb153-kube-api-access-p7glc\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697881 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-cni-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697906 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-host\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-sysctl-d\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.697989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-host\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.698012 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59054940-d2d1-464d-a08b-3586cb3d21aa-multus-cni-dir\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.698053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e475e731-9bc9-4a81-a8ce-e834104aa6be-konnectivity-ca\") pod \"konnectivity-agent-nn8xm\" (UID: \"e475e731-9bc9-4a81-a8ce-e834104aa6be\") " pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.698259 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59054940-d2d1-464d-a08b-3586cb3d21aa-cni-binary-copy\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.699206 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.699150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-etc-tuned\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.699490 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.699292 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e475e731-9bc9-4a81-a8ce-e834104aa6be-agent-certs\") pod \"konnectivity-agent-nn8xm\" (UID: \"e475e731-9bc9-4a81-a8ce-e834104aa6be\") " pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.699707 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.699691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-tmp\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.704133 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.704116 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:40.704212 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.704138 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:40.704212 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.704150 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:40.704212 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:40.704201 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:25:41.204187945 +0000 UTC m=+2.218931436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:40.705984 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.705964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pht4m\" (UniqueName: \"kubernetes.io/projected/59054940-d2d1-464d-a08b-3586cb3d21aa-kube-api-access-pht4m\") pod \"multus-xn9l2\" (UID: \"59054940-d2d1-464d-a08b-3586cb3d21aa\") " pod="openshift-multus/multus-xn9l2" May 26 19:25:40.706213 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.706189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxrvf\" (UniqueName: \"kubernetes.io/projected/2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5-kube-api-access-hxrvf\") pod \"tuned-sxbbw\" (UID: \"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5\") " pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.706287 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.706272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7glc\" (UniqueName: \"kubernetes.io/projected/7577541e-b896-4245-952d-678b254cb153-kube-api-access-p7glc\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:40.706815 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.706800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzjh2\" (UniqueName: \"kubernetes.io/projected/4cd3c417-c859-4c08-b601-ca2df4626cc0-kube-api-access-zzjh2\") pod \"iptables-alerter-nfrts\" (UID: \"4cd3c417-c859-4c08-b601-ca2df4626cc0\") " pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.793219 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.793187 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rmlqf" May 26 19:25:40.799936 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.799911 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9981d3b7_819a_4992_8268_264375709664.slice/crio-d3f3e831be0bb1b66c2801bc51d6bfec95c5e8cddb8fae3d13938fe36ba701df WatchSource:0}: Error finding container d3f3e831be0bb1b66c2801bc51d6bfec95c5e8cddb8fae3d13938fe36ba701df: Status 404 returned error can't find the container with id d3f3e831be0bb1b66c2801bc51d6bfec95c5e8cddb8fae3d13938fe36ba701df May 26 19:25:40.812679 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.812658 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" May 26 19:25:40.818139 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.818115 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd660a004_bccd_4c8a_8bf9_6b14fd8e8240.slice/crio-82c8fc52c35165bb3224c03a27e295dc9cf6f45db4bae34302245c296483c0e8 WatchSource:0}: Error finding container 82c8fc52c35165bb3224c03a27e295dc9cf6f45db4bae34302245c296483c0e8: Status 404 returned error can't find the container with id 82c8fc52c35165bb3224c03a27e295dc9cf6f45db4bae34302245c296483c0e8 May 26 19:25:40.819978 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.819955 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:25:40.825549 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.825525 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484408c5_a961_4221_826c_f965be4b0c0d.slice/crio-1d528b3a205b9341064fc66a4fc14360b74374971a8cce48f9ba2b5923b73fb2 WatchSource:0}: Error finding container 1d528b3a205b9341064fc66a4fc14360b74374971a8cce48f9ba2b5923b73fb2: Status 404 returned error can't find the container with id 1d528b3a205b9341064fc66a4fc14360b74374971a8cce48f9ba2b5923b73fb2 May 26 19:25:40.832418 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.832399 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" May 26 19:25:40.837915 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.837895 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3785e335_a9d9_442d_a2c7_e2e02b756f67.slice/crio-100f9d2afe6bfe4c1689f9b18640cde72fffceb89c2780093fbce09cba25bc58 WatchSource:0}: Error finding container 100f9d2afe6bfe4c1689f9b18640cde72fffceb89c2780093fbce09cba25bc58: Status 404 returned error can't find the container with id 100f9d2afe6bfe4c1689f9b18640cde72fffceb89c2780093fbce09cba25bc58 May 26 19:25:40.848088 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.848069 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7mw7d" May 26 19:25:40.853426 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.853404 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bc48b0_ed2b_495b_89c9_3dddad119bbb.slice/crio-d3bc6a89e30074ec06d7a159f57b477de04e36cb41f6cc3438860980949fce34 WatchSource:0}: Error finding container d3bc6a89e30074ec06d7a159f57b477de04e36cb41f6cc3438860980949fce34: Status 404 returned error can't find the container with id d3bc6a89e30074ec06d7a159f57b477de04e36cb41f6cc3438860980949fce34 May 26 19:25:40.861453 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.861437 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xn9l2" May 26 19:25:40.866845 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.866824 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59054940_d2d1_464d_a08b_3586cb3d21aa.slice/crio-0e381d6202c71cd784cff2f157aec56e6e055abfcdfbe4cec33005daf05acc9c WatchSource:0}: Error finding container 0e381d6202c71cd784cff2f157aec56e6e055abfcdfbe4cec33005daf05acc9c: Status 404 returned error can't find the container with id 0e381d6202c71cd784cff2f157aec56e6e055abfcdfbe4cec33005daf05acc9c May 26 19:25:40.875647 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.875624 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nfrts" May 26 19:25:40.881328 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.881304 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd3c417_c859_4c08_b601_ca2df4626cc0.slice/crio-589161f4fe17adcf3e7c9de5261b22c9e3af9dcd333c439f379c7716c67d403f WatchSource:0}: Error finding container 589161f4fe17adcf3e7c9de5261b22c9e3af9dcd333c439f379c7716c67d403f: Status 404 returned error can't find the container with id 589161f4fe17adcf3e7c9de5261b22c9e3af9dcd333c439f379c7716c67d403f May 26 19:25:40.903833 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.903806 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nn8xm" May 26 19:25:40.910558 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.910321 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode475e731_9bc9_4a81_a8ce_e834104aa6be.slice/crio-d789f42f5c10cb62ddefce1b8aa4ada5183b73e38d7164bb7e27422074b617dc WatchSource:0}: Error finding container d789f42f5c10cb62ddefce1b8aa4ada5183b73e38d7164bb7e27422074b617dc: Status 404 returned error can't find the container with id d789f42f5c10cb62ddefce1b8aa4ada5183b73e38d7164bb7e27422074b617dc May 26 19:25:40.910976 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:40.910956 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" May 26 19:25:40.916981 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:25:40.916954 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c61a505_6eb8_47f7_9d7c_0c70d6ad16a5.slice/crio-ec45ce0d6815a6ea5583b95d785307f8835fabedfed354daa872bbbf03c90c44 WatchSource:0}: Error finding container ec45ce0d6815a6ea5583b95d785307f8835fabedfed354daa872bbbf03c90c44: Status 404 returned error can't find the container with id ec45ce0d6815a6ea5583b95d785307f8835fabedfed354daa872bbbf03c90c44 May 26 19:25:41.202232 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.202191 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:41.202406 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.202338 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:41.202406 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.202398 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:42.202378752 +0000 UTC m=+3.217122230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:41.302992 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.302953 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:41.303178 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.303127 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:41.303178 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.303147 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:41.303178 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.303160 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:41.303366 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.303222 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:25:42.303203525 +0000 UTC m=+3.317947003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:41.441297 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.440991 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:41.528338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.528255 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:20:40 +0000 UTC" deadline="2028-01-23 01:11:24.535188903 +0000 UTC" May 26 19:25:41.528338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.528285 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14549h45m43.006906416s" May 26 19:25:41.589074 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.589043 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:41.616793 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.616122 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:41.616793 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:41.616293 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:41.637342 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.637286 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nfrts" event={"ID":"4cd3c417-c859-4c08-b601-ca2df4626cc0","Type":"ContainerStarted","Data":"589161f4fe17adcf3e7c9de5261b22c9e3af9dcd333c439f379c7716c67d403f"} May 26 19:25:41.652818 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.652773 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xn9l2" event={"ID":"59054940-d2d1-464d-a08b-3586cb3d21aa","Type":"ContainerStarted","Data":"0e381d6202c71cd784cff2f157aec56e6e055abfcdfbe4cec33005daf05acc9c"} May 26 19:25:41.663866 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.663821 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7mw7d" event={"ID":"11bc48b0-ed2b-495b-89c9-3dddad119bbb","Type":"ContainerStarted","Data":"d3bc6a89e30074ec06d7a159f57b477de04e36cb41f6cc3438860980949fce34"} May 26 19:25:41.683087 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.683058 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" event={"ID":"3785e335-a9d9-442d-a2c7-e2e02b756f67","Type":"ContainerStarted","Data":"100f9d2afe6bfe4c1689f9b18640cde72fffceb89c2780093fbce09cba25bc58"} May 26 19:25:41.689069 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.689031 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerStarted","Data":"82c8fc52c35165bb3224c03a27e295dc9cf6f45db4bae34302245c296483c0e8"} May 26 19:25:41.699911 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.699880 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rmlqf" event={"ID":"9981d3b7-819a-4992-8268-264375709664","Type":"ContainerStarted","Data":"d3f3e831be0bb1b66c2801bc51d6bfec95c5e8cddb8fae3d13938fe36ba701df"} May 26 19:25:41.709227 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.709196 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nn8xm" event={"ID":"e475e731-9bc9-4a81-a8ce-e834104aa6be","Type":"ContainerStarted","Data":"d789f42f5c10cb62ddefce1b8aa4ada5183b73e38d7164bb7e27422074b617dc"} May 26 19:25:41.737231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.737197 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"1d528b3a205b9341064fc66a4fc14360b74374971a8cce48f9ba2b5923b73fb2"} May 26 19:25:41.762866 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.762833 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" event={"ID":"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5","Type":"ContainerStarted","Data":"ec45ce0d6815a6ea5583b95d785307f8835fabedfed354daa872bbbf03c90c44"} May 26 19:25:41.776987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:41.776962 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:42.210181 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:42.210144 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:42.210378 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.210290 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:42.210378 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.210358 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:44.210336443 +0000 UTC m=+5.225079919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:42.311449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:42.311414 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:42.311725 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.311706 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:42.311818 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.311735 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:42.311818 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.311748 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:42.311818 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.311809 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:25:44.311790641 +0000 UTC m=+5.326534118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:42.529489 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:42.529397 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:20:40 +0000 UTC" deadline="2027-11-06 11:14:39.566672102 +0000 UTC" May 26 19:25:42.529489 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:42.529436 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12687h48m57.037239688s" May 26 19:25:42.610061 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:42.610030 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:42.610215 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:42.610160 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:43.613198 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:43.612672 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:43.613198 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:43.612819 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:44.228919 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:44.228884 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:44.229112 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.229005 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:44.229112 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.229081 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:48.229060481 +0000 UTC m=+9.243803968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:44.330142 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:44.330107 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:44.330320 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.330262 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:44.330320 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.330282 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:44.330320 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.330294 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:44.330453 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.330353 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:25:48.330332302 +0000 UTC m=+9.345075777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:44.610149 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:44.610071 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:44.610306 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:44.610194 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:45.611880 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:45.611381 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:45.611880 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:45.611536 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:46.609632 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:46.609583 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:46.609865 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:46.609809 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:47.610537 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:47.610064 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:47.610537 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:47.610209 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:48.263025 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:48.262990 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:48.263208 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.263152 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:48.263268 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.263230 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:56.263208569 +0000 UTC m=+17.277952063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:48.364307 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:48.364266 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:48.364475 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.364454 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:48.364475 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.364474 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:48.364581 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.364485 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:48.364581 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.364545 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:25:56.364526006 +0000 UTC m=+17.379269504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:48.610732 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:48.610153 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:48.610732 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:48.610312 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:49.610829 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:49.610794 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:49.611267 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:49.610909 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:50.609510 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:50.609465 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:50.609751 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:50.609576 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:51.609646 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:51.609594 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:51.610123 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:51.609720 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:52.610316 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:52.610285 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:52.610715 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:52.610396 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:53.610542 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:53.610504 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:53.611019 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:53.610668 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:54.610155 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:54.610114 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:54.610346 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:54.610236 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:55.610131 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:55.610045 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:55.610561 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:55.610194 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:56.320882 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:56.320839 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:56.321084 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.320985 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:56.321084 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.321055 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:12.321036919 +0000 UTC m=+33.335780402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:56.422015 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:56.421987 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:56.422177 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.422127 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:56.422177 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.422142 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:56.422177 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.422152 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:56.422296 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.422198 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:12.422186047 +0000 UTC m=+33.436929522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:56.610073 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:56.609996 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:56.610211 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:56.610120 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:57.610181 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:57.610146 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:57.610445 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:57.610288 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:25:58.610195 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:58.610147 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:25:58.610362 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:58.610280 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:25:59.610357 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:25:59.610325 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:25:59.610686 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:25:59.610437 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:00.610706 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.610309 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:00.611401 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:00.610775 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:00.800276 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.800241 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rmlqf" event={"ID":"9981d3b7-819a-4992-8268-264375709664","Type":"ContainerStarted","Data":"1d1267aeaedcbee4e4d8231fe14dae53ed63fcaad3bcf74a7641268c6f258673"} May 26 19:26:00.801739 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.801709 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" event={"ID":"e67b3710d712693834df395e6efd6c96","Type":"ContainerStarted","Data":"dc41a240580495c33b15f076ca4d8d07cf646f079c1990461f7d66569cd6aabf"} May 26 19:26:00.803149 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.803125 2572 generic.go:358] "Generic (PLEG): container finished" podID="ed88b466c3e7296d13af6fa3dbdaf250" containerID="fb3263d9c8a1ad751518b26b90c3e4a5f1708c1d5a810e55d08018b8ff3daab1" exitCode=0 May 26 19:26:00.803252 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.803198 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"ed88b466c3e7296d13af6fa3dbdaf250","Type":"ContainerDied","Data":"fb3263d9c8a1ad751518b26b90c3e4a5f1708c1d5a810e55d08018b8ff3daab1"} May 26 19:26:00.804742 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.804708 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nn8xm" event={"ID":"e475e731-9bc9-4a81-a8ce-e834104aa6be","Type":"ContainerStarted","Data":"b84d23858380eb8ce373d7022c6325cbc90687877a3b39dad5fa43bfe9293e9a"} May 26 19:26:00.807399 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.807378 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"5f94d97302ed5ee5e8653e3c20748b036be2ca23eb201cc199e17c9a9c8409e6"} May 26 19:26:00.807399 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.807406 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"7f47c1e8639fd834183e240a646dbfa3b34e715accfec27b7ab6b97784c5daad"} May 26 19:26:00.807531 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.807420 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"068798e3d5430e18f60c3169dd355b86d363fa41fc7e421de5e708a4d45876a9"} May 26 19:26:00.807531 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.807433 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"fbb706f786893c0b3222fce0f2431d7e06a08a0937503953a348dd1e66ebbf32"} May 26 19:26:00.807531 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.807446 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"3754b73b12afa1cfed0bc4f88ba3b53b0e4df5076f4391b84c46026f54b5e5d8"} May 26 19:26:00.807531 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.807458 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"bb3d78e89728c601a19bc7bba86ccd1f06860d201fe9f0edcbd057fdebf3f62b"} May 26 19:26:00.808667 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.808641 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" event={"ID":"2c61a505-6eb8-47f7-9d7c-0c70d6ad16a5","Type":"ContainerStarted","Data":"80b3c3ecf3c7a4ab87a0d4b5573255ab968f641a6994e6bf516ca41c4dbebe4c"} May 26 19:26:00.809931 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.809908 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xn9l2" event={"ID":"59054940-d2d1-464d-a08b-3586cb3d21aa","Type":"ContainerStarted","Data":"035973c4c741cdb1195326d138839b5ee7694262d158bf5647facc277630736a"} May 26 19:26:00.811155 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.811136 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7mw7d" event={"ID":"11bc48b0-ed2b-495b-89c9-3dddad119bbb","Type":"ContainerStarted","Data":"3499b22bd41fdf0b19e8e86b6b306e199406d0750021c0026c9619c5a2ab99da"} May 26 19:26:00.812418 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.812397 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" event={"ID":"3785e335-a9d9-442d-a2c7-e2e02b756f67","Type":"ContainerStarted","Data":"70e4f797d461556804c28b334723f8cb1a541f3a01a8f139f0cd9aed9c7558e0"} May 26 19:26:00.813882 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.813838 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rmlqf" podStartSLOduration=3.011314881 podStartE2EDuration="21.81380989s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.801393255 +0000 UTC m=+1.816136733" lastFinishedPulling="2026-05-26 19:25:59.603888256 +0000 UTC m=+20.618631742" observedRunningTime="2026-05-26 19:26:00.813740214 +0000 UTC m=+21.828483712" watchObservedRunningTime="2026-05-26 19:26:00.81380989 +0000 UTC m=+21.828553404" May 26 19:26:00.813991 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.813876 2572 generic.go:358] "Generic (PLEG): container finished" podID="d660a004-bccd-4c8a-8bf9-6b14fd8e8240" containerID="d20a050c1b19ab9e85dd8ca1a66800936027973fbe7eae0ecbc006e4fe35b8c4" exitCode=0 May 26 19:26:00.813991 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.813908 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerDied","Data":"d20a050c1b19ab9e85dd8ca1a66800936027973fbe7eae0ecbc006e4fe35b8c4"} May 26 19:26:00.842097 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.842049 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sxbbw" podStartSLOduration=3.154279987 podStartE2EDuration="21.842031868s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.91864555 +0000 UTC m=+1.933389041" lastFinishedPulling="2026-05-26 19:25:59.606397447 +0000 UTC m=+20.621140922" observedRunningTime="2026-05-26 19:26:00.829378763 +0000 UTC m=+21.844122261" watchObservedRunningTime="2026-05-26 19:26:00.842031868 +0000 UTC m=+21.856775369" May 26 19:26:00.855725 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.855685 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-212.ec2.internal" podStartSLOduration=21.855673151 podStartE2EDuration="21.855673151s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:26:00.842124928 +0000 UTC m=+21.856868427" watchObservedRunningTime="2026-05-26 19:26:00.855673151 +0000 UTC m=+21.870416649" May 26 19:26:00.884282 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.884211 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7mw7d" podStartSLOduration=7.432466689 podStartE2EDuration="21.884198144s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.854932012 +0000 UTC m=+1.869675490" lastFinishedPulling="2026-05-26 19:25:55.306663455 +0000 UTC m=+16.321406945" observedRunningTime="2026-05-26 19:26:00.868725543 +0000 UTC m=+21.883469041" watchObservedRunningTime="2026-05-26 19:26:00.884198144 +0000 UTC m=+21.898941653" May 26 19:26:00.884369 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.884295 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xn9l2" podStartSLOduration=2.8322538699999997 podStartE2EDuration="21.884290984s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.868282477 +0000 UTC m=+1.883025956" lastFinishedPulling="2026-05-26 19:25:59.92031958 +0000 UTC m=+20.935063070" observedRunningTime="2026-05-26 19:26:00.883920751 +0000 UTC m=+21.898664249" watchObservedRunningTime="2026-05-26 19:26:00.884290984 +0000 UTC m=+21.899034509" May 26 19:26:00.901319 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:00.901277 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nn8xm" podStartSLOduration=3.238555808 podStartE2EDuration="21.901267619s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.911968175 +0000 UTC m=+1.926711653" lastFinishedPulling="2026-05-26 19:25:59.574679988 +0000 UTC m=+20.589423464" observedRunningTime="2026-05-26 19:26:00.90099875 +0000 UTC m=+21.915742247" watchObservedRunningTime="2026-05-26 19:26:00.901267619 +0000 UTC m=+21.916011115" May 26 19:26:01.249866 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.249845 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 19:26:01.549475 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.549371 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T19:26:01.249862829Z","UUID":"f0c6d13c-6a6e-490c-9bb8-2cd549ec4abe","Handler":null,"Name":"","Endpoint":""} May 26 19:26:01.551108 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.551083 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 19:26:01.551108 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.551113 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 19:26:01.610130 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.610102 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:01.610273 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:01.610241 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:01.818237 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.818154 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" event={"ID":"ed88b466c3e7296d13af6fa3dbdaf250","Type":"ContainerStarted","Data":"ffb8db961def8c0e61373ef9d2def7379877705f5aa148b05fc47d1e121e4ea4"} May 26 19:26:01.819830 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.819628 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nfrts" event={"ID":"4cd3c417-c859-4c08-b601-ca2df4626cc0","Type":"ContainerStarted","Data":"7d24e2400b81aaef9add2e9f77db9aad8fb64b15e42f9b1aa7921bec946a7796"} May 26 19:26:01.821871 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.821780 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" event={"ID":"3785e335-a9d9-442d-a2c7-e2e02b756f67","Type":"ContainerStarted","Data":"7886bd8baead1fb9701fc7d68125b212b24b6f7aa9efca6797884367b529fbc0"} May 26 19:26:01.833447 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:01.833405 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-212.ec2.internal" podStartSLOduration=22.83339006 podStartE2EDuration="22.83339006s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:26:01.833176561 +0000 UTC m=+22.847920062" watchObservedRunningTime="2026-05-26 19:26:01.83339006 +0000 UTC m=+22.848133570" May 26 19:26:02.609968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:02.609781 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:02.610140 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:02.610064 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:02.825869 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:02.825768 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" event={"ID":"3785e335-a9d9-442d-a2c7-e2e02b756f67","Type":"ContainerStarted","Data":"aca960fbcf31fa65323ef84437027d13d936ff7adce8c5c97a06d762304a8470"} May 26 19:26:02.830581 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:02.830550 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"88da8bcbbe06b310dabd15fbaa4045de39d85117c71fc4296ced121229e480ed"} May 26 19:26:02.843628 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:02.843567 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g8f7" podStartSLOduration=2.629002787 podStartE2EDuration="23.843551246s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.839270453 +0000 UTC m=+1.854013931" lastFinishedPulling="2026-05-26 19:26:02.053818901 +0000 UTC m=+23.068562390" observedRunningTime="2026-05-26 19:26:02.843197067 +0000 UTC m=+23.857940565" watchObservedRunningTime="2026-05-26 19:26:02.843551246 +0000 UTC m=+23.858294743" May 26 19:26:02.843974 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:02.843947 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nfrts" podStartSLOduration=5.151993508 podStartE2EDuration="23.843939647s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.882734521 +0000 UTC m=+1.897477995" lastFinishedPulling="2026-05-26 19:25:59.574680655 +0000 UTC m=+20.589424134" observedRunningTime="2026-05-26 19:26:01.850801898 +0000 UTC m=+22.865545396" watchObservedRunningTime="2026-05-26 19:26:02.843939647 +0000 UTC m=+23.858683159" May 26 19:26:03.609908 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:03.609873 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:03.610117 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:03.610006 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:04.610151 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:04.610118 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:04.610719 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:04.610277 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:04.837110 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:04.836978 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" event={"ID":"484408c5-a961-4221-826c-f965be4b0c0d","Type":"ContainerStarted","Data":"1c99e1b50216381719bd9cad925ca3be57aa0bab7ba91ca3495930ff2019feed"} May 26 19:26:04.838523 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:04.838286 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:26:04.838523 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:04.838317 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:26:04.855998 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:04.855634 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:26:04.863418 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:04.863373 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" podStartSLOduration=6.804229094 podStartE2EDuration="25.863357345s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.827006551 +0000 UTC m=+1.841750030" lastFinishedPulling="2026-05-26 19:25:59.886134805 +0000 UTC m=+20.900878281" observedRunningTime="2026-05-26 19:26:04.863144746 +0000 UTC m=+25.877888242" watchObservedRunningTime="2026-05-26 19:26:04.863357345 +0000 UTC m=+25.878100841" May 26 19:26:05.408726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.408494 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nn8xm" May 26 19:26:05.409680 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.409658 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nn8xm" May 26 19:26:05.609626 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.609591 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:05.609795 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:05.609717 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:05.840346 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.840313 2572 generic.go:358] "Generic (PLEG): container finished" podID="d660a004-bccd-4c8a-8bf9-6b14fd8e8240" containerID="1cfb3e7f6c3150f3907355375c625513a46b549389d75ef88267bfb812431fdc" exitCode=0 May 26 19:26:05.841262 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.840395 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerDied","Data":"1cfb3e7f6c3150f3907355375c625513a46b549389d75ef88267bfb812431fdc"} May 26 19:26:05.841262 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.841146 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:26:05.841262 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.841174 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nn8xm" May 26 19:26:05.841990 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.841518 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nn8xm" May 26 19:26:05.856562 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:05.856540 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:26:06.609450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.609427 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:06.609578 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:06.609552 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:06.743114 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.743077 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9cx8"] May 26 19:26:06.743596 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.743521 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94xc5"] May 26 19:26:06.743730 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.743634 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:06.743770 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:06.743727 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:06.843686 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.843656 2572 generic.go:358] "Generic (PLEG): container finished" podID="d660a004-bccd-4c8a-8bf9-6b14fd8e8240" containerID="cc03cdd3945d2a8f49902d2003d15cdbaf8ad5edfd260ddf7752f727852fdaac" exitCode=0 May 26 19:26:06.844050 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.843757 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerDied","Data":"cc03cdd3945d2a8f49902d2003d15cdbaf8ad5edfd260ddf7752f727852fdaac"} May 26 19:26:06.844050 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:06.843786 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:06.844148 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:06.844087 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:07.847849 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:07.847815 2572 generic.go:358] "Generic (PLEG): container finished" podID="d660a004-bccd-4c8a-8bf9-6b14fd8e8240" containerID="aba596e90ef1c8e02ee27eb5e65ee4798b1b9eb0a4c02d7f75e8107378a60d38" exitCode=0 May 26 19:26:07.848210 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:07.847902 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerDied","Data":"aba596e90ef1c8e02ee27eb5e65ee4798b1b9eb0a4c02d7f75e8107378a60d38"} May 26 19:26:08.609729 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:08.609694 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:08.609910 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:08.609696 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:08.609910 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:08.609838 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:08.609910 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:08.609897 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:10.609843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:10.609809 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:10.610559 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:10.609809 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:10.610559 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:10.609958 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:10.610559 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:10.610047 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:12.346009 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.345968 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:12.346647 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.346141 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:26:12.346647 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.346226 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:44.34620532 +0000 UTC m=+65.360948805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:26:12.446602 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.446565 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:12.446798 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.446752 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:26:12.446798 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.446779 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:26:12.446798 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.446790 2572 projected.go:194] Error preparing data for projected volume kube-api-access-8zplw for pod openshift-network-diagnostics/network-check-target-k9cx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:26:12.446953 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.446864 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw podName:9a675dcb-fce9-42f5-96c5-5b177460b27e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:44.446839939 +0000 UTC m=+65.461583430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zplw" (UniqueName: "kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw") pod "network-check-target-k9cx8" (UID: "9a675dcb-fce9-42f5-96c5-5b177460b27e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:26:12.610475 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.610394 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:12.610475 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.610418 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:12.610713 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.610511 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9cx8" podUID="9a675dcb-fce9-42f5-96c5-5b177460b27e" May 26 19:26:12.610713 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:12.610694 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:26:12.755518 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.755490 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-212.ec2.internal" event="NodeReady" May 26 19:26:12.755719 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.755608 2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 19:26:12.800443 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.800401 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-smpfm"] May 26 19:26:12.831377 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.831344 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ckdkh"] May 26 19:26:12.831557 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.831532 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smpfm" May 26 19:26:12.834430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.834240 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 19:26:12.834430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.834278 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtv8f\"" May 26 19:26:12.834430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.834278 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 19:26:12.843389 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.843369 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smpfm"] May 26 19:26:12.843389 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.843391 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckdkh"] May 26 19:26:12.843529 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.843480 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:12.846103 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.846082 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 19:26:12.846279 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.846259 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 19:26:12.846399 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.846365 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 19:26:12.846509 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.846454 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhp6d\"" May 26 19:26:12.949798 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.949739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:12.949798 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.949850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvjxx\" (UniqueName: \"kubernetes.io/projected/1b84a051-b9e7-400c-887f-851052532150-kube-api-access-bvjxx\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:12.950148 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.949892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfvd\" (UniqueName: \"kubernetes.io/projected/ce5dc346-b4ea-4319-8fc4-644e2d102418-kube-api-access-sjfvd\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:12.950148 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.949997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce5dc346-b4ea-4319-8fc4-644e2d102418-config-volume\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:12.950148 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.950026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:12.950148 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:12.950049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5dc346-b4ea-4319-8fc4-644e2d102418-tmp-dir\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.050741 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.050707 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvjxx\" (UniqueName: \"kubernetes.io/projected/1b84a051-b9e7-400c-887f-851052532150-kube-api-access-bvjxx\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:13.050934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.050754 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfvd\" (UniqueName: \"kubernetes.io/projected/ce5dc346-b4ea-4319-8fc4-644e2d102418-kube-api-access-sjfvd\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.050934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.050799 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce5dc346-b4ea-4319-8fc4-644e2d102418-config-volume\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.050934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.050821 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.050934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.050843 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5dc346-b4ea-4319-8fc4-644e2d102418-tmp-dir\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.050934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.050887 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:13.051175 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.050962 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:13.051175 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.050987 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:13.051175 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.051037 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:13.551017328 +0000 UTC m=+34.565760807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:13.051175 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.051055 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:13.551047037 +0000 UTC m=+34.565790511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:13.061382 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.061354 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5dc346-b4ea-4319-8fc4-644e2d102418-tmp-dir\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.061562 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.061540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce5dc346-b4ea-4319-8fc4-644e2d102418-config-volume\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.063811 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.063785 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfvd\" (UniqueName: \"kubernetes.io/projected/ce5dc346-b4ea-4319-8fc4-644e2d102418-kube-api-access-sjfvd\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.063910 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.063847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvjxx\" (UniqueName: \"kubernetes.io/projected/1b84a051-b9e7-400c-887f-851052532150-kube-api-access-bvjxx\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:13.554273 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.554087 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:13.554785 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:13.554296 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:13.554785 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.554239 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:13.554785 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.554372 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:13.554785 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.554412 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:14.554398967 +0000 UTC m=+35.569142442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:13.554785 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:13.554425 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:14.554418376 +0000 UTC m=+35.569161851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:14.562041 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.562007 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:14.562430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.562078 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:14.562430 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:14.562157 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:14.562430 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:14.562211 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:16.56219633 +0000 UTC m=+37.576939818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:14.562430 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:14.562161 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:14.562430 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:14.562274 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:16.562262639 +0000 UTC m=+37.577006124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:14.609993 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.609963 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:14.610117 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.609964 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:14.613655 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.613628 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 19:26:14.613655 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.613644 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g26n\"" May 26 19:26:14.613655 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.613654 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 19:26:14.613902 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.613660 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 19:26:14.613902 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.613732 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9trh\"" May 26 19:26:14.864299 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.864224 2572 generic.go:358] "Generic (PLEG): container finished" podID="d660a004-bccd-4c8a-8bf9-6b14fd8e8240" containerID="ba01e6dfaab25f9085c9e32985f8bec0737f3824b1fc22ed43b3fef32493d57a" exitCode=0 May 26 19:26:14.864299 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:14.864287 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerDied","Data":"ba01e6dfaab25f9085c9e32985f8bec0737f3824b1fc22ed43b3fef32493d57a"} May 26 19:26:15.868271 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:15.868241 2572 generic.go:358] "Generic (PLEG): container finished" podID="d660a004-bccd-4c8a-8bf9-6b14fd8e8240" containerID="2f6ab2b9677d7f0d469e5c82d5a7611fd5b723a74b8ac9659b4f631cc98d4da1" exitCode=0 May 26 19:26:15.868685 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:15.868302 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerDied","Data":"2f6ab2b9677d7f0d469e5c82d5a7611fd5b723a74b8ac9659b4f631cc98d4da1"} May 26 19:26:16.576730 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:16.576638 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:16.576730 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:16.576691 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:16.576936 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:16.576778 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:16.576936 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:16.576791 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:16.576936 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:16.576830 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:20.576816001 +0000 UTC m=+41.591559476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:16.576936 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:16.576852 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:20.576835543 +0000 UTC m=+41.591579018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:16.872967 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:16.872880 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" event={"ID":"d660a004-bccd-4c8a-8bf9-6b14fd8e8240","Type":"ContainerStarted","Data":"ea7352f342800da9f8c275997eb7eda4390b2604210c052eb0035e7e4b6ed419"} May 26 19:26:16.916915 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:16.916864 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l9c8r" podStartSLOduration=4.863797621 podStartE2EDuration="37.916848827s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:25:40.819819753 +0000 UTC m=+1.834563228" lastFinishedPulling="2026-05-26 19:26:13.872870947 +0000 UTC m=+34.887614434" observedRunningTime="2026-05-26 19:26:16.916688898 +0000 UTC m=+37.931432396" watchObservedRunningTime="2026-05-26 19:26:16.916848827 +0000 UTC m=+37.931592324" May 26 19:26:20.601845 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:20.601815 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:20.602237 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:20.601867 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:20.602237 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:20.601963 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:20.602237 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:20.601966 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:20.602237 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:20.602012 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:28.601998832 +0000 UTC m=+49.616742307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:20.602237 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:20.602024 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:28.60201907 +0000 UTC m=+49.616762545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:28.655573 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:28.655528 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:28.656065 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:28.655586 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:28.656065 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:28.655692 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:28.656065 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:28.655693 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:28.656065 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:28.655746 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:44.655730997 +0000 UTC m=+65.670474473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:28.656065 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:28.655758 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:44.655752437 +0000 UTC m=+65.670495911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:37.858858 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:37.858820 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59ptn" May 26 19:26:44.365535 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.365494 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:26:44.368268 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.368247 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 19:26:44.376369 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:44.376349 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 19:26:44.376464 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:44.376418 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:48.376396513 +0000 UTC m=+129.391140001 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : secret "metrics-daemon-secret" not found May 26 19:26:44.466841 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.466799 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:44.469498 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.469476 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 19:26:44.479756 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.479732 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 19:26:44.491209 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.491179 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zplw\" (UniqueName: \"kubernetes.io/projected/9a675dcb-fce9-42f5-96c5-5b177460b27e-kube-api-access-8zplw\") pod \"network-check-target-k9cx8\" (UID: \"9a675dcb-fce9-42f5-96c5-5b177460b27e\") " pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:44.621877 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.621792 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g26n\"" May 26 19:26:44.629970 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.629952 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:44.668178 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.668142 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:26:44.668324 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.668209 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:26:44.668324 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:44.668296 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:44.668392 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:44.668322 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:44.668392 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:44.668353 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:16.668334177 +0000 UTC m=+97.683077652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:26:44.668463 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:26:44.668401 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:16.668381383 +0000 UTC m=+97.683124865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:26:44.816831 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.816801 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9cx8"] May 26 19:26:44.820185 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:26:44.820146 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a675dcb_fce9_42f5_96c5_5b177460b27e.slice/crio-c27371485a8f3cb7dc26d171cc132c2f6194eea9b9b01fd9a738448726a9781a WatchSource:0}: Error finding container c27371485a8f3cb7dc26d171cc132c2f6194eea9b9b01fd9a738448726a9781a: Status 404 returned error can't find the container with id c27371485a8f3cb7dc26d171cc132c2f6194eea9b9b01fd9a738448726a9781a May 26 19:26:44.922593 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:44.922507 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9cx8" event={"ID":"9a675dcb-fce9-42f5-96c5-5b177460b27e","Type":"ContainerStarted","Data":"c27371485a8f3cb7dc26d171cc132c2f6194eea9b9b01fd9a738448726a9781a"} May 26 19:26:47.929134 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:47.929090 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9cx8" event={"ID":"9a675dcb-fce9-42f5-96c5-5b177460b27e","Type":"ContainerStarted","Data":"2c7710183799185ee53e01c464a298d64819925dd2c90f12ab5a4f3b201efca4"} May 26 19:26:47.929504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:47.929215 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:26:47.944386 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:26:47.944338 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k9cx8" podStartSLOduration=66.377425354 podStartE2EDuration="1m8.944325182s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:26:44.822117931 +0000 UTC m=+65.836861419" lastFinishedPulling="2026-05-26 19:26:47.389017773 +0000 UTC m=+68.403761247" observedRunningTime="2026-05-26 19:26:47.943875113 +0000 UTC m=+68.958618604" watchObservedRunningTime="2026-05-26 19:26:47.944325182 +0000 UTC m=+68.959068678" May 26 19:27:16.677330 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:16.677243 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:27:16.677330 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:16.677290 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:27:16.677767 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:16.677403 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:27:16.677767 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:16.677457 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:27:16.677767 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:16.677472 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:20.677455484 +0000 UTC m=+161.692198959 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:27:16.677767 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:16.677513 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:20.677500634 +0000 UTC m=+161.692244109 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:27:18.933751 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:18.933719 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k9cx8" May 26 19:27:48.390541 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:48.390497 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:27:48.391025 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:48.390641 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 19:27:48.391025 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:48.390710 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs podName:7577541e-b896-4245-952d-678b254cb153 nodeName:}" failed. No retries permitted until 2026-05-26 19:29:50.390694723 +0000 UTC m=+251.405438197 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs") pod "network-metrics-daemon-94xc5" (UID: "7577541e-b896-4245-952d-678b254cb153") : secret "metrics-daemon-secret" not found May 26 19:27:57.273557 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.273525 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr"] May 26 19:27:57.276371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.276325 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.276920 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.276894 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7kwtj"] May 26 19:27:57.279499 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.279483 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79dc7dd876-xpmtj"] May 26 19:27:57.279645 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.279627 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.279974 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.279951 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 19:27:57.280306 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.280281 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 26 19:27:57.280422 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.280333 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 19:27:57.280422 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.280290 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 26 19:27:57.280422 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.280414 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tjp69\"" May 26 19:27:57.281880 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.281860 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 26 19:27:57.282105 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.282089 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 19:27:57.282234 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.282143 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.282234 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.282205 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 19:27:57.282415 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.282279 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2glz8\"" May 26 19:27:57.282752 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.282736 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 26 19:27:57.284677 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.284658 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 26 19:27:57.285142 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.285124 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 26 19:27:57.285233 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.285158 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zpl2l\"" May 26 19:27:57.285233 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.285175 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 19:27:57.285430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.285414 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 26 19:27:57.285489 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.285477 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 26 19:27:57.285540 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.285479 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 19:27:57.287066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.287048 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr"] May 26 19:27:57.287757 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.287739 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 26 19:27:57.291132 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.290866 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7kwtj"] May 26 19:27:57.291853 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.291832 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79dc7dd876-xpmtj"] May 26 19:27:57.350810 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.350776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhcdt\" (UniqueName: \"kubernetes.io/projected/e1ed8051-6098-4124-8d0b-eefd559e2bc9-kube-api-access-lhcdt\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.350986 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.350832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e1ed8051-6098-4124-8d0b-eefd559e2bc9-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.350986 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.350850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.451212 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451159 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e1ed8051-6098-4124-8d0b-eefd559e2bc9-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.451212 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451218 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.451449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.451449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsw6g\" (UniqueName: \"kubernetes.io/projected/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-kube-api-access-lsw6g\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.451449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-tmp\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.451449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.451449 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.451409 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 19:27:57.451449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-serving-cert\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-default-certificate\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.451479 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls podName:e1ed8051-6098-4124-8d0b-eefd559e2bc9 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:57.951462124 +0000 UTC m=+138.966205599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-q8qpr" (UID: "e1ed8051-6098-4124-8d0b-eefd559e2bc9") : secret "cluster-monitoring-operator-tls" not found May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-stats-auth\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562bl\" (UniqueName: \"kubernetes.io/projected/f101134a-e37c-4bc0-9bbc-aef5294cb842-kube-api-access-562bl\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-snapshots\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451592 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcdt\" (UniqueName: \"kubernetes.io/projected/e1ed8051-6098-4124-8d0b-eefd559e2bc9-kube-api-access-lhcdt\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.451672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.451987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.451987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.451932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e1ed8051-6098-4124-8d0b-eefd559e2bc9-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.461942 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.461917 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhcdt\" (UniqueName: \"kubernetes.io/projected/e1ed8051-6098-4124-8d0b-eefd559e2bc9-kube-api-access-lhcdt\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.552885 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.552806 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-snapshots\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.552885 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.552843 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.552885 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.552863 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.553101 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.553050 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 19:27:57.553158 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.553122 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:58.053101474 +0000 UTC m=+139.067844949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : secret "router-metrics-certs-default" not found May 26 19:27:57.553158 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553060 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553265 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553175 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsw6g\" (UniqueName: \"kubernetes.io/projected/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-kube-api-access-lsw6g\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553265 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553226 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-tmp\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553379 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553284 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-snapshots\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553379 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553341 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.553496 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553377 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553496 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553379 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-serving-cert\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553496 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553418 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-default-certificate\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.553496 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553437 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-stats-auth\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.553702 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.553500 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:58.053483278 +0000 UTC m=+139.068226755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : configmap references non-existent config key: service-ca.crt May 26 19:27:57.553702 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-tmp\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.553702 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553524 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-562bl\" (UniqueName: \"kubernetes.io/projected/f101134a-e37c-4bc0-9bbc-aef5294cb842-kube-api-access-562bl\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.553858 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.553798 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.555719 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.555698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-serving-cert\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.555811 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.555756 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-default-certificate\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.556541 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.556517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-stats-auth\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.562399 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.562376 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-562bl\" (UniqueName: \"kubernetes.io/projected/f101134a-e37c-4bc0-9bbc-aef5294cb842-kube-api-access-562bl\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:57.562485 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.562468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsw6g\" (UniqueName: \"kubernetes.io/projected/ed05dfac-c7b4-4686-b8e6-df8042fd4bd3-kube-api-access-lsw6g\") pod \"insights-operator-78bdfb888c-7kwtj\" (UID: \"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3\") " pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.594231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.594211 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" May 26 19:27:57.708843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.708812 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7kwtj"] May 26 19:27:57.711672 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:27:57.711644 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded05dfac_c7b4_4686_b8e6_df8042fd4bd3.slice/crio-d7cbe27edd4878e1797058466f855d66799d8ad63fbe8e7ea6b75629c1d4ca9a WatchSource:0}: Error finding container d7cbe27edd4878e1797058466f855d66799d8ad63fbe8e7ea6b75629c1d4ca9a: Status 404 returned error can't find the container with id d7cbe27edd4878e1797058466f855d66799d8ad63fbe8e7ea6b75629c1d4ca9a May 26 19:27:57.956114 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:57.956084 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:57.956258 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.956230 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 19:27:57.956314 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:57.956305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls podName:e1ed8051-6098-4124-8d0b-eefd559e2bc9 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:58.95628859 +0000 UTC m=+139.971032065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-q8qpr" (UID: "e1ed8051-6098-4124-8d0b-eefd559e2bc9") : secret "cluster-monitoring-operator-tls" not found May 26 19:27:58.056980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:58.056949 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:58.057147 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:58.057087 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 19:27:58.057147 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:58.057095 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:58.057233 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:58.057161 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:59.057141782 +0000 UTC m=+140.071885257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : secret "router-metrics-certs-default" not found May 26 19:27:58.057233 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:58.057179 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:59.057170802 +0000 UTC m=+140.071914277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : configmap references non-existent config key: service-ca.crt May 26 19:27:58.059007 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:58.058983 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" event={"ID":"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3","Type":"ContainerStarted","Data":"d7cbe27edd4878e1797058466f855d66799d8ad63fbe8e7ea6b75629c1d4ca9a"} May 26 19:27:58.965376 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:58.965339 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:27:58.965846 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:58.965494 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 19:27:58.965846 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:58.965584 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls podName:e1ed8051-6098-4124-8d0b-eefd559e2bc9 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:00.965563485 +0000 UTC m=+141.980306967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-q8qpr" (UID: "e1ed8051-6098-4124-8d0b-eefd559e2bc9") : secret "cluster-monitoring-operator-tls" not found May 26 19:27:59.066003 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:59.065966 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:59.066179 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:59.066076 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 19:27:59.066179 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:27:59.066086 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:27:59.066179 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:59.066145 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:01.066122794 +0000 UTC m=+142.080866269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : secret "router-metrics-certs-default" not found May 26 19:27:59.066349 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:27:59.066220 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:01.066204472 +0000 UTC m=+142.080947963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : configmap references non-existent config key: service-ca.crt May 26 19:28:00.064048 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:00.064008 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" event={"ID":"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3","Type":"ContainerStarted","Data":"5b750eed996276e83ea0cfcb82d03138144947d986d4fa717c702b30ae498ce0"} May 26 19:28:00.083218 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:00.083175 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" podStartSLOduration=1.32403016 podStartE2EDuration="3.083161943s" podCreationTimestamp="2026-05-26 19:27:57 +0000 UTC" firstStartedPulling="2026-05-26 19:27:57.71328306 +0000 UTC m=+138.728026535" lastFinishedPulling="2026-05-26 19:27:59.472414841 +0000 UTC m=+140.487158318" observedRunningTime="2026-05-26 19:28:00.081556212 +0000 UTC m=+141.096299709" watchObservedRunningTime="2026-05-26 19:28:00.083161943 +0000 UTC m=+141.097905439" May 26 19:28:00.982348 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:00.982313 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:28:00.982509 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:00.982460 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 19:28:00.982555 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:00.982524 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls podName:e1ed8051-6098-4124-8d0b-eefd559e2bc9 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:04.982507173 +0000 UTC m=+145.997250649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-q8qpr" (UID: "e1ed8051-6098-4124-8d0b-eefd559e2bc9") : secret "cluster-monitoring-operator-tls" not found May 26 19:28:01.083184 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:01.083150 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:01.083521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:01.083243 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:01.083521 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:01.083291 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 19:28:01.083521 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:01.083353 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:05.083334902 +0000 UTC m=+146.098078386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : secret "router-metrics-certs-default" not found May 26 19:28:01.083521 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:01.083368 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:05.083361692 +0000 UTC m=+146.098105168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : configmap references non-existent config key: service-ca.crt May 26 19:28:02.750467 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:02.750440 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmlqf_9981d3b7-819a-4992-8268-264375709664/dns-node-resolver/0.log" May 26 19:28:03.549719 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:03.549690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7mw7d_11bc48b0-ed2b-495b-89c9-3dddad119bbb/node-ca/0.log" May 26 19:28:05.015139 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:05.015077 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:28:05.015541 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:05.015216 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 19:28:05.015541 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:05.015283 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls podName:e1ed8051-6098-4124-8d0b-eefd559e2bc9 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:13.015265619 +0000 UTC m=+154.030009096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-q8qpr" (UID: "e1ed8051-6098-4124-8d0b-eefd559e2bc9") : secret "cluster-monitoring-operator-tls" not found May 26 19:28:05.116182 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:05.116142 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:05.116394 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:05.116233 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:05.116394 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:05.116314 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 19:28:05.116394 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:05.116352 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:13.116336117 +0000 UTC m=+154.131079592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : configmap references non-existent config key: service-ca.crt May 26 19:28:05.116394 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:05.116383 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:13.116364637 +0000 UTC m=+154.131108114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : secret "router-metrics-certs-default" not found May 26 19:28:07.177354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.177318 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k"] May 26 19:28:07.180388 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.180367 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" May 26 19:28:07.183940 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.183913 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 26 19:28:07.183940 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.183913 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ws7fq\"" May 26 19:28:07.184078 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.183955 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 26 19:28:07.184816 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.184798 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cbfhm"] May 26 19:28:07.187520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.187496 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.188909 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.188888 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k"] May 26 19:28:07.190013 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.189982 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 19:28:07.190381 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.190348 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4zgmn\"" May 26 19:28:07.190854 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.190832 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 19:28:07.190961 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.190938 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 19:28:07.192257 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.192236 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 19:28:07.199297 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.199275 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cbfhm"] May 26 19:28:07.199607 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.199581 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 19:28:07.332741 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.332705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/905fd8df-4fe1-41dc-9ecc-33b66ea21964-config\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.332741 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.332739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/905fd8df-4fe1-41dc-9ecc-33b66ea21964-serving-cert\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.332937 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.332765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/905fd8df-4fe1-41dc-9ecc-33b66ea21964-trusted-ca\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.332937 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.332817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7g4\" (UniqueName: \"kubernetes.io/projected/905fd8df-4fe1-41dc-9ecc-33b66ea21964-kube-api-access-gp7g4\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.332937 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.332837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4x8s\" (UniqueName: \"kubernetes.io/projected/f13d8c97-33ab-4eaf-91eb-f8ae324ac681-kube-api-access-l4x8s\") pod \"volume-data-source-validator-5cf8c89d64-ccj9k\" (UID: \"f13d8c97-33ab-4eaf-91eb-f8ae324ac681\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" May 26 19:28:07.433235 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.433143 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4x8s\" (UniqueName: \"kubernetes.io/projected/f13d8c97-33ab-4eaf-91eb-f8ae324ac681-kube-api-access-l4x8s\") pod \"volume-data-source-validator-5cf8c89d64-ccj9k\" (UID: \"f13d8c97-33ab-4eaf-91eb-f8ae324ac681\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" May 26 19:28:07.433402 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.433256 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/905fd8df-4fe1-41dc-9ecc-33b66ea21964-config\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.433402 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.433281 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/905fd8df-4fe1-41dc-9ecc-33b66ea21964-serving-cert\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.433402 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.433315 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/905fd8df-4fe1-41dc-9ecc-33b66ea21964-trusted-ca\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.433402 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.433355 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7g4\" (UniqueName: \"kubernetes.io/projected/905fd8df-4fe1-41dc-9ecc-33b66ea21964-kube-api-access-gp7g4\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.433932 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.433910 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/905fd8df-4fe1-41dc-9ecc-33b66ea21964-config\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.434064 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.434045 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/905fd8df-4fe1-41dc-9ecc-33b66ea21964-trusted-ca\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.435697 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.435670 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/905fd8df-4fe1-41dc-9ecc-33b66ea21964-serving-cert\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.441312 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.441291 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7g4\" (UniqueName: \"kubernetes.io/projected/905fd8df-4fe1-41dc-9ecc-33b66ea21964-kube-api-access-gp7g4\") pod \"console-operator-76dff48d59-cbfhm\" (UID: \"905fd8df-4fe1-41dc-9ecc-33b66ea21964\") " pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.441900 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.441884 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4x8s\" (UniqueName: \"kubernetes.io/projected/f13d8c97-33ab-4eaf-91eb-f8ae324ac681-kube-api-access-l4x8s\") pod \"volume-data-source-validator-5cf8c89d64-ccj9k\" (UID: \"f13d8c97-33ab-4eaf-91eb-f8ae324ac681\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" May 26 19:28:07.489729 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.489692 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" May 26 19:28:07.500481 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.500459 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:07.614775 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.614737 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k"] May 26 19:28:07.619272 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:07.619242 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13d8c97_33ab_4eaf_91eb_f8ae324ac681.slice/crio-58566ca6e41c15a9daf54efd4c742b8f69c969114bb910e728327e58869f4cdb WatchSource:0}: Error finding container 58566ca6e41c15a9daf54efd4c742b8f69c969114bb910e728327e58869f4cdb: Status 404 returned error can't find the container with id 58566ca6e41c15a9daf54efd4c742b8f69c969114bb910e728327e58869f4cdb May 26 19:28:07.630626 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:07.630591 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cbfhm"] May 26 19:28:07.633515 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:07.633495 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905fd8df_4fe1_41dc_9ecc_33b66ea21964.slice/crio-27ee86ec371f9eb0ae8df6d8681d848354c070bc6ee69ced5ca2ec836b76ecbd WatchSource:0}: Error finding container 27ee86ec371f9eb0ae8df6d8681d848354c070bc6ee69ced5ca2ec836b76ecbd: Status 404 returned error can't find the container with id 27ee86ec371f9eb0ae8df6d8681d848354c070bc6ee69ced5ca2ec836b76ecbd May 26 19:28:08.079539 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:08.079501 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" event={"ID":"f13d8c97-33ab-4eaf-91eb-f8ae324ac681","Type":"ContainerStarted","Data":"58566ca6e41c15a9daf54efd4c742b8f69c969114bb910e728327e58869f4cdb"} May 26 19:28:08.080410 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:08.080385 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" event={"ID":"905fd8df-4fe1-41dc-9ecc-33b66ea21964","Type":"ContainerStarted","Data":"27ee86ec371f9eb0ae8df6d8681d848354c070bc6ee69ced5ca2ec836b76ecbd"} May 26 19:28:10.085709 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:10.085597 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" event={"ID":"f13d8c97-33ab-4eaf-91eb-f8ae324ac681","Type":"ContainerStarted","Data":"f722c6b4d8fb3f1d7c94dee149ac426ec3f9bd3da2a1964cab51d99e136fb2e9"} May 26 19:28:10.086964 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:10.086944 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/0.log" May 26 19:28:10.087049 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:10.086978 2572 generic.go:358] "Generic (PLEG): container finished" podID="905fd8df-4fe1-41dc-9ecc-33b66ea21964" containerID="42b8d3563a9835a66160ec258cc67dcc19307a36d7819f6cd90567ae3ffb9ec9" exitCode=255 May 26 19:28:10.087049 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:10.087005 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" event={"ID":"905fd8df-4fe1-41dc-9ecc-33b66ea21964","Type":"ContainerDied","Data":"42b8d3563a9835a66160ec258cc67dcc19307a36d7819f6cd90567ae3ffb9ec9"} May 26 19:28:10.087226 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:10.087212 2572 scope.go:117] "RemoveContainer" containerID="42b8d3563a9835a66160ec258cc67dcc19307a36d7819f6cd90567ae3ffb9ec9" May 26 19:28:10.100090 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:10.100016 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-ccj9k" podStartSLOduration=0.960998302 podStartE2EDuration="3.100001124s" podCreationTimestamp="2026-05-26 19:28:07 +0000 UTC" firstStartedPulling="2026-05-26 19:28:07.620908459 +0000 UTC m=+148.635651938" lastFinishedPulling="2026-05-26 19:28:09.759911285 +0000 UTC m=+150.774654760" observedRunningTime="2026-05-26 19:28:10.099831022 +0000 UTC m=+151.114574524" watchObservedRunningTime="2026-05-26 19:28:10.100001124 +0000 UTC m=+151.114744622" May 26 19:28:11.090017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:11.089989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:28:11.090393 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:11.090377 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/0.log" May 26 19:28:11.090449 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:11.090413 2572 generic.go:358] "Generic (PLEG): container finished" podID="905fd8df-4fe1-41dc-9ecc-33b66ea21964" containerID="8f5c10bc10ee660d12d1f93a444eb2de00462cd11357f8f50e3869782eea0112" exitCode=255 May 26 19:28:11.090533 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:11.090510 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" event={"ID":"905fd8df-4fe1-41dc-9ecc-33b66ea21964","Type":"ContainerDied","Data":"8f5c10bc10ee660d12d1f93a444eb2de00462cd11357f8f50e3869782eea0112"} May 26 19:28:11.090582 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:11.090556 2572 scope.go:117] "RemoveContainer" containerID="42b8d3563a9835a66160ec258cc67dcc19307a36d7819f6cd90567ae3ffb9ec9" May 26 19:28:11.090879 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:11.090859 2572 scope.go:117] "RemoveContainer" containerID="8f5c10bc10ee660d12d1f93a444eb2de00462cd11357f8f50e3869782eea0112" May 26 19:28:11.091041 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:11.091019 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cbfhm_openshift-console-operator(905fd8df-4fe1-41dc-9ecc-33b66ea21964)\"" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" podUID="905fd8df-4fe1-41dc-9ecc-33b66ea21964" May 26 19:28:12.093544 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:12.093516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:28:12.094043 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:12.093936 2572 scope.go:117] "RemoveContainer" containerID="8f5c10bc10ee660d12d1f93a444eb2de00462cd11357f8f50e3869782eea0112" May 26 19:28:12.094163 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:12.094142 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cbfhm_openshift-console-operator(905fd8df-4fe1-41dc-9ecc-33b66ea21964)\"" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" podUID="905fd8df-4fe1-41dc-9ecc-33b66ea21964" May 26 19:28:13.081228 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:13.081194 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:28:13.081404 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:13.081312 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 19:28:13.081404 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:13.081371 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls podName:e1ed8051-6098-4124-8d0b-eefd559e2bc9 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:29.081356996 +0000 UTC m=+170.096100471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-q8qpr" (UID: "e1ed8051-6098-4124-8d0b-eefd559e2bc9") : secret "cluster-monitoring-operator-tls" not found May 26 19:28:13.181517 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:13.181481 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:13.181920 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:13.181565 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:13.181920 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:13.181641 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 19:28:13.181920 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:13.181713 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:29.181696098 +0000 UTC m=+170.196439576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : secret "router-metrics-certs-default" not found May 26 19:28:13.181920 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:13.181728 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle podName:f101134a-e37c-4bc0-9bbc-aef5294cb842 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:29.181722204 +0000 UTC m=+170.196465683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle") pod "router-default-79dc7dd876-xpmtj" (UID: "f101134a-e37c-4bc0-9bbc-aef5294cb842") : configmap references non-existent config key: service-ca.crt May 26 19:28:14.208223 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.208180 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5lt74"] May 26 19:28:14.213665 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.213640 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.216030 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.216010 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 19:28:14.216149 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.216009 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 19:28:14.216149 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.216012 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvgwn\"" May 26 19:28:14.221124 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.221099 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lt74"] May 26 19:28:14.289851 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.289799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.290017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.289877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.290017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.289903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg8pv\" (UniqueName: \"kubernetes.io/projected/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-kube-api-access-hg8pv\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.290017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.289925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-crio-socket\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.290017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.289963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-data-volume\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390666 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390599 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-crio-socket\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390729 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390706 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-data-volume\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390774 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390720 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-crio-socket\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390810 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390768 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390839 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390809 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390871 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390837 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg8pv\" (UniqueName: \"kubernetes.io/projected/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-kube-api-access-hg8pv\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.390941 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:14.390927 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:14.390996 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.390981 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-data-volume\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.391033 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:14.390994 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls podName:c3b57306-5a8f-4116-bc9a-371b47ec8b5d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:14.890975159 +0000 UTC m=+155.905718637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lt74" (UID: "c3b57306-5a8f-4116-bc9a-371b47ec8b5d") : secret "insights-runtime-extractor-tls" not found May 26 19:28:14.391297 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.391279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.399666 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.399638 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg8pv\" (UniqueName: \"kubernetes.io/projected/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-kube-api-access-hg8pv\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.774958 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.774928 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9qxm6"] May 26 19:28:14.778995 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.778978 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.781773 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.781755 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 26 19:28:14.782234 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.782216 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 26 19:28:14.782312 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.782255 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 26 19:28:14.782375 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.782358 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 26 19:28:14.782935 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.782917 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d8j74\"" May 26 19:28:14.788211 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.788191 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9qxm6"] May 26 19:28:14.793511 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.793487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7dbad2f6-1481-451b-bd5c-3769008ac339-signing-key\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.793631 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.793520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfq6n\" (UniqueName: \"kubernetes.io/projected/7dbad2f6-1481-451b-bd5c-3769008ac339-kube-api-access-bfq6n\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.793631 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.793557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7dbad2f6-1481-451b-bd5c-3769008ac339-signing-cabundle\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.894826 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.894772 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7dbad2f6-1481-451b-bd5c-3769008ac339-signing-key\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.894826 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.894832 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfq6n\" (UniqueName: \"kubernetes.io/projected/7dbad2f6-1481-451b-bd5c-3769008ac339-kube-api-access-bfq6n\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.895050 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.894861 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7dbad2f6-1481-451b-bd5c-3769008ac339-signing-cabundle\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.895050 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.894889 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:14.895050 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:14.894981 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:14.895050 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:14.895033 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls podName:c3b57306-5a8f-4116-bc9a-371b47ec8b5d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:15.895016997 +0000 UTC m=+156.909760471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lt74" (UID: "c3b57306-5a8f-4116-bc9a-371b47ec8b5d") : secret "insights-runtime-extractor-tls" not found May 26 19:28:14.895553 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.895535 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7dbad2f6-1481-451b-bd5c-3769008ac339-signing-cabundle\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.897088 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.897065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7dbad2f6-1481-451b-bd5c-3769008ac339-signing-key\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:14.904918 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:14.904895 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfq6n\" (UniqueName: \"kubernetes.io/projected/7dbad2f6-1481-451b-bd5c-3769008ac339-kube-api-access-bfq6n\") pod \"service-ca-67d667c7d-9qxm6\" (UID: \"7dbad2f6-1481-451b-bd5c-3769008ac339\") " pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:15.087935 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:15.087862 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" May 26 19:28:15.206013 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:15.205981 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9qxm6"] May 26 19:28:15.209089 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:15.209066 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbad2f6_1481_451b_bd5c_3769008ac339.slice/crio-33a42610ce6141a0d67fc93298d37167067aab07e0089d506fb35faee29da8cb WatchSource:0}: Error finding container 33a42610ce6141a0d67fc93298d37167067aab07e0089d506fb35faee29da8cb: Status 404 returned error can't find the container with id 33a42610ce6141a0d67fc93298d37167067aab07e0089d506fb35faee29da8cb May 26 19:28:15.842756 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:15.842717 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-smpfm" podUID="ce5dc346-b4ea-4319-8fc4-644e2d102418" May 26 19:28:15.853858 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:15.853812 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ckdkh" podUID="1b84a051-b9e7-400c-887f-851052532150" May 26 19:28:15.903498 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:15.903458 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:15.903697 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:15.903625 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:15.903697 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:15.903696 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls podName:c3b57306-5a8f-4116-bc9a-371b47ec8b5d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:17.90367905 +0000 UTC m=+158.918422525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lt74" (UID: "c3b57306-5a8f-4116-bc9a-371b47ec8b5d") : secret "insights-runtime-extractor-tls" not found May 26 19:28:16.102740 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:16.102645 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" event={"ID":"7dbad2f6-1481-451b-bd5c-3769008ac339","Type":"ContainerStarted","Data":"33a42610ce6141a0d67fc93298d37167067aab07e0089d506fb35faee29da8cb"} May 26 19:28:16.102740 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:16.102673 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smpfm" May 26 19:28:17.105530 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:17.105441 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" event={"ID":"7dbad2f6-1481-451b-bd5c-3769008ac339","Type":"ContainerStarted","Data":"9b15b320bb5e53c7f80e74b68b762b21f1a9a68b7c79ff47f4c05e9de698ddc4"} May 26 19:28:17.126460 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:17.126411 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-9qxm6" podStartSLOduration=1.578010569 podStartE2EDuration="3.126397836s" podCreationTimestamp="2026-05-26 19:28:14 +0000 UTC" firstStartedPulling="2026-05-26 19:28:15.210689902 +0000 UTC m=+156.225433378" lastFinishedPulling="2026-05-26 19:28:16.759077156 +0000 UTC m=+157.773820645" observedRunningTime="2026-05-26 19:28:17.12476423 +0000 UTC m=+158.139507723" watchObservedRunningTime="2026-05-26 19:28:17.126397836 +0000 UTC m=+158.141141332" May 26 19:28:17.501217 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:17.501183 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:17.501217 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:17.501225 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:17.501667 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:17.501648 2572 scope.go:117] "RemoveContainer" containerID="8f5c10bc10ee660d12d1f93a444eb2de00462cd11357f8f50e3869782eea0112" May 26 19:28:17.501921 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:17.501895 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cbfhm_openshift-console-operator(905fd8df-4fe1-41dc-9ecc-33b66ea21964)\"" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" podUID="905fd8df-4fe1-41dc-9ecc-33b66ea21964" May 26 19:28:17.624579 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:17.624540 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-94xc5" podUID="7577541e-b896-4245-952d-678b254cb153" May 26 19:28:17.920941 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:17.920844 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:17.921073 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:17.920991 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:17.921073 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:17.921060 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls podName:c3b57306-5a8f-4116-bc9a-371b47ec8b5d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:21.921042814 +0000 UTC m=+162.935786288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lt74" (UID: "c3b57306-5a8f-4116-bc9a-371b47ec8b5d") : secret "insights-runtime-extractor-tls" not found May 26 19:28:20.745321 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:20.745281 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:28:20.745817 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:20.745364 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:28:20.745817 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:20.745441 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:28:20.745817 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:20.745504 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert podName:1b84a051-b9e7-400c-887f-851052532150 nodeName:}" failed. No retries permitted until 2026-05-26 19:30:22.745487388 +0000 UTC m=+283.760230862 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert") pod "ingress-canary-ckdkh" (UID: "1b84a051-b9e7-400c-887f-851052532150") : secret "canary-serving-cert" not found May 26 19:28:20.745817 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:20.745447 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:28:20.745817 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:20.745589 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls podName:ce5dc346-b4ea-4319-8fc4-644e2d102418 nodeName:}" failed. No retries permitted until 2026-05-26 19:30:22.745571058 +0000 UTC m=+283.760314533 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls") pod "dns-default-smpfm" (UID: "ce5dc346-b4ea-4319-8fc4-644e2d102418") : secret "dns-default-metrics-tls" not found May 26 19:28:21.954148 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:21.954085 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:21.954679 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:21.954210 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:21.954679 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:21.954283 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls podName:c3b57306-5a8f-4116-bc9a-371b47ec8b5d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:29.954267036 +0000 UTC m=+170.969010515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lt74" (UID: "c3b57306-5a8f-4116-bc9a-371b47ec8b5d") : secret "insights-runtime-extractor-tls" not found May 26 19:28:29.110900 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.110803 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:28:29.113264 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.113237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ed8051-6098-4124-8d0b-eefd559e2bc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-q8qpr\" (UID: \"e1ed8051-6098-4124-8d0b-eefd559e2bc9\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:28:29.211607 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.211576 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:29.211771 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.211636 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:29.212167 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.212142 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f101134a-e37c-4bc0-9bbc-aef5294cb842-service-ca-bundle\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:29.213906 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.213879 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f101134a-e37c-4bc0-9bbc-aef5294cb842-metrics-certs\") pod \"router-default-79dc7dd876-xpmtj\" (UID: \"f101134a-e37c-4bc0-9bbc-aef5294cb842\") " pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:29.387626 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.387535 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" May 26 19:28:29.399542 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.399505 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:29.515278 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.515256 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr"] May 26 19:28:29.517499 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:29.517466 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ed8051_6098_4124_8d0b_eefd559e2bc9.slice/crio-81e2d70dc932e14f676a119b57c97ef7cc3d3f69dcc783e3b5b2a2b68643ffe3 WatchSource:0}: Error finding container 81e2d70dc932e14f676a119b57c97ef7cc3d3f69dcc783e3b5b2a2b68643ffe3: Status 404 returned error can't find the container with id 81e2d70dc932e14f676a119b57c97ef7cc3d3f69dcc783e3b5b2a2b68643ffe3 May 26 19:28:29.531559 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:29.531534 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79dc7dd876-xpmtj"] May 26 19:28:29.534798 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:29.534767 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf101134a_e37c_4bc0_9bbc_aef5294cb842.slice/crio-135ed1305dfe866edf6862858b49e168f072377fb6c7cb897e398e1004c2524f WatchSource:0}: Error finding container 135ed1305dfe866edf6862858b49e168f072377fb6c7cb897e398e1004c2524f: Status 404 returned error can't find the container with id 135ed1305dfe866edf6862858b49e168f072377fb6c7cb897e398e1004c2524f May 26 19:28:30.017745 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.017706 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:30.020384 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.020359 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3b57306-5a8f-4116-bc9a-371b47ec8b5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lt74\" (UID: \"c3b57306-5a8f-4116-bc9a-371b47ec8b5d\") " pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:30.122082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.122054 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lt74" May 26 19:28:30.132685 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.132649 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" event={"ID":"f101134a-e37c-4bc0-9bbc-aef5294cb842","Type":"ContainerStarted","Data":"d9b06cf9ddfcac985b4c27816a67b6c76473ada85956dd4543411bc5b1114540"} May 26 19:28:30.132685 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.132694 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" event={"ID":"f101134a-e37c-4bc0-9bbc-aef5294cb842","Type":"ContainerStarted","Data":"135ed1305dfe866edf6862858b49e168f072377fb6c7cb897e398e1004c2524f"} May 26 19:28:30.133901 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.133875 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" event={"ID":"e1ed8051-6098-4124-8d0b-eefd559e2bc9","Type":"ContainerStarted","Data":"81e2d70dc932e14f676a119b57c97ef7cc3d3f69dcc783e3b5b2a2b68643ffe3"} May 26 19:28:30.150820 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.150771 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" podStartSLOduration=33.150756857 podStartE2EDuration="33.150756857s" podCreationTimestamp="2026-05-26 19:27:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:28:30.15018542 +0000 UTC m=+171.164928917" watchObservedRunningTime="2026-05-26 19:28:30.150756857 +0000 UTC m=+171.165500354" May 26 19:28:30.242843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.242810 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lt74"] May 26 19:28:30.246276 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:30.246243 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b57306_5a8f_4116_bc9a_371b47ec8b5d.slice/crio-71573c3731c10cbb0c4835149f3d5d950ffa5b33df2e645ff2aae1ae7832e22b WatchSource:0}: Error finding container 71573c3731c10cbb0c4835149f3d5d950ffa5b33df2e645ff2aae1ae7832e22b: Status 404 returned error can't find the container with id 71573c3731c10cbb0c4835149f3d5d950ffa5b33df2e645ff2aae1ae7832e22b May 26 19:28:30.399956 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.399919 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:30.402436 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.402410 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:30.610233 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.610146 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:28:30.610400 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:30.610146 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:28:31.138861 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:31.138830 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lt74" event={"ID":"c3b57306-5a8f-4116-bc9a-371b47ec8b5d","Type":"ContainerStarted","Data":"c1582df26065e57c0c80e0e6c7bec2a4ccb3b0812c56752825d5e7abc4ea70de"} May 26 19:28:31.139240 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:31.138867 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lt74" event={"ID":"c3b57306-5a8f-4116-bc9a-371b47ec8b5d","Type":"ContainerStarted","Data":"370d8682246deffc83b6865e46e4434006ec30e3c4dc2ebdec4dc92206a32d6b"} May 26 19:28:31.139240 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:31.138877 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lt74" event={"ID":"c3b57306-5a8f-4116-bc9a-371b47ec8b5d","Type":"ContainerStarted","Data":"71573c3731c10cbb0c4835149f3d5d950ffa5b33df2e645ff2aae1ae7832e22b"} May 26 19:28:31.139240 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:31.139179 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:31.140476 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:31.140452 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79dc7dd876-xpmtj" May 26 19:28:32.142380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:32.142342 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" event={"ID":"e1ed8051-6098-4124-8d0b-eefd559e2bc9","Type":"ContainerStarted","Data":"40d974759f8e62924adfe127d5566414ed8e8510f094aa5a064561a3304c0ae7"} May 26 19:28:32.158354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:32.158280 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-q8qpr" podStartSLOduration=33.142037183 podStartE2EDuration="35.158262982s" podCreationTimestamp="2026-05-26 19:27:57 +0000 UTC" firstStartedPulling="2026-05-26 19:28:29.519220231 +0000 UTC m=+170.533963709" lastFinishedPulling="2026-05-26 19:28:31.53544603 +0000 UTC m=+172.550189508" observedRunningTime="2026-05-26 19:28:32.156850591 +0000 UTC m=+173.171594087" watchObservedRunningTime="2026-05-26 19:28:32.158262982 +0000 UTC m=+173.173006482" May 26 19:28:32.609976 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:32.609944 2572 scope.go:117] "RemoveContainer" containerID="8f5c10bc10ee660d12d1f93a444eb2de00462cd11357f8f50e3869782eea0112" May 26 19:28:33.146284 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:33.146251 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lt74" event={"ID":"c3b57306-5a8f-4116-bc9a-371b47ec8b5d","Type":"ContainerStarted","Data":"b70ae0a4b6665be782e2d1299a3e8bc12d4426252c982fa7f6824851c4938a35"} May 26 19:28:33.147921 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:33.147901 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:28:33.148046 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:33.147954 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" event={"ID":"905fd8df-4fe1-41dc-9ecc-33b66ea21964","Type":"ContainerStarted","Data":"619d2c93759f4377912a413161de054872f1f052d75b2eb730635d98cadff09a"} May 26 19:28:33.148419 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:33.148401 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:33.163488 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:33.163449 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5lt74" podStartSLOduration=16.428155169 podStartE2EDuration="19.163438794s" podCreationTimestamp="2026-05-26 19:28:14 +0000 UTC" firstStartedPulling="2026-05-26 19:28:30.297726104 +0000 UTC m=+171.312469590" lastFinishedPulling="2026-05-26 19:28:33.033009738 +0000 UTC m=+174.047753215" observedRunningTime="2026-05-26 19:28:33.161871606 +0000 UTC m=+174.176615103" watchObservedRunningTime="2026-05-26 19:28:33.163438794 +0000 UTC m=+174.178182288" May 26 19:28:33.176218 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:33.176094 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" podStartSLOduration=24.088187719 podStartE2EDuration="26.176086048s" podCreationTimestamp="2026-05-26 19:28:07 +0000 UTC" firstStartedPulling="2026-05-26 19:28:07.635116405 +0000 UTC m=+148.649859883" lastFinishedPulling="2026-05-26 19:28:09.723014733 +0000 UTC m=+150.737758212" observedRunningTime="2026-05-26 19:28:33.176025614 +0000 UTC m=+174.190769111" watchObservedRunningTime="2026-05-26 19:28:33.176086048 +0000 UTC m=+174.190829577" May 26 19:28:34.095826 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.095796 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-cbfhm" May 26 19:28:34.489520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.489486 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82"] May 26 19:28:34.492562 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.492543 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:34.495213 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.495193 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 26 19:28:34.495342 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.495313 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m79xf\"" May 26 19:28:34.502047 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.502021 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82"] May 26 19:28:34.555738 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.555705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/658fa14c-e5e3-4b48-89fc-086c227437ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jvl82\" (UID: \"658fa14c-e5e3-4b48-89fc-086c227437ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:34.598477 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.598448 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9d8c474b-xqwjk"] May 26 19:28:34.601386 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.601368 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.604386 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.604355 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dljqb\"" May 26 19:28:34.604484 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.604410 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 19:28:34.604484 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.604425 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 19:28:34.604651 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.604560 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 19:28:34.609849 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.609828 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 19:28:34.614526 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.614506 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9d8c474b-xqwjk"] May 26 19:28:34.656386 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-bound-sa-token\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656508 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-image-registry-private-configuration\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656508 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-installation-pull-secrets\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656822 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-trusted-ca\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656822 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656546 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-registry-tls\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656822 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-registry-certificates\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656822 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hbl5\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-kube-api-access-2hbl5\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.656822 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656748 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/658fa14c-e5e3-4b48-89fc-086c227437ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jvl82\" (UID: \"658fa14c-e5e3-4b48-89fc-086c227437ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:34.656822 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.656776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-ca-trust-extracted\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.659049 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.659031 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/658fa14c-e5e3-4b48-89fc-086c227437ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jvl82\" (UID: \"658fa14c-e5e3-4b48-89fc-086c227437ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:34.757328 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757257 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-trusted-ca\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757328 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757296 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-registry-tls\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757328 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757318 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-registry-certificates\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757567 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757365 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hbl5\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-kube-api-access-2hbl5\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757567 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757392 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-ca-trust-extracted\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757567 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757438 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-bound-sa-token\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757567 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757468 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-image-registry-private-configuration\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757567 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757523 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-installation-pull-secrets\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.757906 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.757880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-ca-trust-extracted\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.758231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.758204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-registry-certificates\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.758585 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.758562 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-trusted-ca\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.760164 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.760130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-image-registry-private-configuration\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.760302 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.760286 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-registry-tls\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.760341 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.760303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-installation-pull-secrets\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.766758 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.766732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-bound-sa-token\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.766891 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.766871 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hbl5\" (UniqueName: \"kubernetes.io/projected/803b66fd-4b74-4ba0-9e9b-8525abe4d5ea-kube-api-access-2hbl5\") pod \"image-registry-5b9d8c474b-xqwjk\" (UID: \"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea\") " pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.802597 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.802573 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:34.911294 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.911238 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:34.929483 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:34.929434 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82"] May 26 19:28:34.932811 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:34.932780 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658fa14c_e5e3_4b48_89fc_086c227437ab.slice/crio-e4539f637006de74504c53b618c140f1dc760e0cfb55f1b8abf95f16f2441dd5 WatchSource:0}: Error finding container e4539f637006de74504c53b618c140f1dc760e0cfb55f1b8abf95f16f2441dd5: Status 404 returned error can't find the container with id e4539f637006de74504c53b618c140f1dc760e0cfb55f1b8abf95f16f2441dd5 May 26 19:28:35.040884 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:35.040802 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9d8c474b-xqwjk"] May 26 19:28:35.044939 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:35.044910 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803b66fd_4b74_4ba0_9e9b_8525abe4d5ea.slice/crio-251bb634509a1b74aaf3a136d0d5525fdd5dfe2b275d79299d88fb5480591ee4 WatchSource:0}: Error finding container 251bb634509a1b74aaf3a136d0d5525fdd5dfe2b275d79299d88fb5480591ee4: Status 404 returned error can't find the container with id 251bb634509a1b74aaf3a136d0d5525fdd5dfe2b275d79299d88fb5480591ee4 May 26 19:28:35.154524 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:35.154486 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" event={"ID":"658fa14c-e5e3-4b48-89fc-086c227437ab","Type":"ContainerStarted","Data":"e4539f637006de74504c53b618c140f1dc760e0cfb55f1b8abf95f16f2441dd5"} May 26 19:28:35.155717 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:35.155688 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" event={"ID":"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea","Type":"ContainerStarted","Data":"20d798a018d6cf2110e7da783a7321c49f71e583422f5d384a8163c826290f4c"} May 26 19:28:35.155812 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:35.155727 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" event={"ID":"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea","Type":"ContainerStarted","Data":"251bb634509a1b74aaf3a136d0d5525fdd5dfe2b275d79299d88fb5480591ee4"} May 26 19:28:35.175510 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:35.175462 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podStartSLOduration=1.175446932 podStartE2EDuration="1.175446932s" podCreationTimestamp="2026-05-26 19:28:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:28:35.174333614 +0000 UTC m=+176.189077111" watchObservedRunningTime="2026-05-26 19:28:35.175446932 +0000 UTC m=+176.190190428" May 26 19:28:36.159391 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:36.159368 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:28:37.162840 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:37.162804 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" event={"ID":"658fa14c-e5e3-4b48-89fc-086c227437ab","Type":"ContainerStarted","Data":"ae3a4a9e39ef9ffd098613d2652d35929dea6945ebe83ec66056155e7d7bb684"} May 26 19:28:37.178574 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:37.178499 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" podStartSLOduration=2.005960443 podStartE2EDuration="3.178484027s" podCreationTimestamp="2026-05-26 19:28:34 +0000 UTC" firstStartedPulling="2026-05-26 19:28:34.934750977 +0000 UTC m=+175.949494451" lastFinishedPulling="2026-05-26 19:28:36.107274549 +0000 UTC m=+177.122018035" observedRunningTime="2026-05-26 19:28:37.177217327 +0000 UTC m=+178.191960823" watchObservedRunningTime="2026-05-26 19:28:37.178484027 +0000 UTC m=+178.193227524" May 26 19:28:38.166450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:38.166419 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:38.170963 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:38.170940 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jvl82" May 26 19:28:43.440305 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.440266 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hkdg6"] May 26 19:28:43.445210 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.445186 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.447797 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.447772 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 19:28:43.447918 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.447800 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 19:28:43.448072 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.448059 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 19:28:43.448143 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.448126 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 19:28:43.448748 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.448728 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gkhmx\"" May 26 19:28:43.527601 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbqqf\" (UniqueName: \"kubernetes.io/projected/8195b26e-a37a-41d9-9619-f8dc51e69cd1-kube-api-access-fbqqf\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527789 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527789 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-sys\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527789 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-wtmp\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527942 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527942 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527874 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-tls\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527942 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-textfile\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.527942 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.527930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8195b26e-a37a-41d9-9619-f8dc51e69cd1-metrics-client-ca\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.528138 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.528011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-root\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.628954 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.628918 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-wtmp\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629138 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.628963 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629138 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629042 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-tls\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629138 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629083 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-textfile\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629138 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629112 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8195b26e-a37a-41d9-9619-f8dc51e69cd1-metrics-client-ca\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629169 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-root\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:43.629218 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629227 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-wtmp\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629214 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbqqf\" (UniqueName: \"kubernetes.io/projected/8195b26e-a37a-41d9-9619-f8dc51e69cd1-kube-api-access-fbqqf\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:28:43.629284 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-tls podName:8195b26e-a37a-41d9-9619-f8dc51e69cd1 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:44.129263269 +0000 UTC m=+185.144006749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-tls") pod "node-exporter-hkdg6" (UID: "8195b26e-a37a-41d9-9619-f8dc51e69cd1") : secret "node-exporter-tls" not found May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629286 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-root\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629319 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629659 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629370 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-sys\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629659 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629459 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8195b26e-a37a-41d9-9619-f8dc51e69cd1-sys\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629659 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629767 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8195b26e-a37a-41d9-9619-f8dc51e69cd1-metrics-client-ca\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.629767 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.629732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-textfile\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.631679 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.631656 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:43.639728 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:43.639705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbqqf\" (UniqueName: \"kubernetes.io/projected/8195b26e-a37a-41d9-9619-f8dc51e69cd1-kube-api-access-fbqqf\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:44.133817 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:44.133782 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-tls\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:44.136048 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:44.136018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8195b26e-a37a-41d9-9619-f8dc51e69cd1-node-exporter-tls\") pod \"node-exporter-hkdg6\" (UID: \"8195b26e-a37a-41d9-9619-f8dc51e69cd1\") " pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:44.356700 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:44.356667 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hkdg6" May 26 19:28:45.191156 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:45.191118 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkdg6" event={"ID":"8195b26e-a37a-41d9-9619-f8dc51e69cd1","Type":"ContainerStarted","Data":"70ad1a52f9f68fe2fbea1b04bab6eb53b502828eaa962df117f5294ac82e271c"} May 26 19:28:46.195083 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:46.195047 2572 generic.go:358] "Generic (PLEG): container finished" podID="8195b26e-a37a-41d9-9619-f8dc51e69cd1" containerID="e70ce19c5201e25aa1894adefeb0974285efb5a7e576d34b1cb0c626a8814fda" exitCode=0 May 26 19:28:46.195457 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:46.195131 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkdg6" event={"ID":"8195b26e-a37a-41d9-9619-f8dc51e69cd1","Type":"ContainerDied","Data":"e70ce19c5201e25aa1894adefeb0974285efb5a7e576d34b1cb0c626a8814fda"} May 26 19:28:47.199863 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:47.199828 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkdg6" event={"ID":"8195b26e-a37a-41d9-9619-f8dc51e69cd1","Type":"ContainerStarted","Data":"187b0994ea0bf59fdc3197017c0fc9d0b8c8e4c7874013021b8b38d6317036b5"} May 26 19:28:47.199863 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:47.199862 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkdg6" event={"ID":"8195b26e-a37a-41d9-9619-f8dc51e69cd1","Type":"ContainerStarted","Data":"26e7eacac46751abfc6ba385289b8df33ad5980bda1f60791a7219ae89579f26"} May 26 19:28:47.220045 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:47.220003 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hkdg6" podStartSLOduration=3.244411235 podStartE2EDuration="4.21999128s" podCreationTimestamp="2026-05-26 19:28:43 +0000 UTC" firstStartedPulling="2026-05-26 19:28:44.370643086 +0000 UTC m=+185.385386573" lastFinishedPulling="2026-05-26 19:28:45.346223126 +0000 UTC m=+186.360966618" observedRunningTime="2026-05-26 19:28:47.218056288 +0000 UTC m=+188.232799784" watchObservedRunningTime="2026-05-26 19:28:47.21999128 +0000 UTC m=+188.234734777" May 26 19:28:48.593950 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.593895 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86b7f78cf7-44k72"] May 26 19:28:48.596157 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.596140 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.598791 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.598739 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 26 19:28:48.598791 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.598766 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fvcww\"" May 26 19:28:48.598791 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.598777 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 26 19:28:48.599013 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.598904 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 26 19:28:48.599076 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.599020 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 26 19:28:48.599185 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.599165 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 26 19:28:48.603979 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.603962 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 26 19:28:48.612288 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.612270 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86b7f78cf7-44k72"] May 26 19:28:48.674516 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-federate-client-tls\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674649 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674528 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-secret-telemeter-client\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674649 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-metrics-client-ca\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674649 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674649 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wzr6\" (UniqueName: \"kubernetes.io/projected/458fed78-e616-4a8a-bd06-132803c40897-kube-api-access-7wzr6\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-serving-certs-ca-bundle\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-telemeter-client-tls\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.674847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.674830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775591 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775553 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-federate-client-tls\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775591 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775595 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-secret-telemeter-client\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775825 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775631 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-metrics-client-ca\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775825 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775676 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775825 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775705 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wzr6\" (UniqueName: \"kubernetes.io/projected/458fed78-e616-4a8a-bd06-132803c40897-kube-api-access-7wzr6\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775825 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775748 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-serving-certs-ca-bundle\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.775825 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775815 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-telemeter-client-tls\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.776085 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.775842 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.776540 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.776505 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-metrics-client-ca\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.778876 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.778845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-secret-telemeter-client\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.779277 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.779239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.779338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.779276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-federate-client-tls\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.779338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.779258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-serving-certs-ca-bundle\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.783136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.783109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/458fed78-e616-4a8a-bd06-132803c40897-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.785947 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.785921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/458fed78-e616-4a8a-bd06-132803c40897-telemeter-client-tls\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.786164 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.786145 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wzr6\" (UniqueName: \"kubernetes.io/projected/458fed78-e616-4a8a-bd06-132803c40897-kube-api-access-7wzr6\") pod \"telemeter-client-86b7f78cf7-44k72\" (UID: \"458fed78-e616-4a8a-bd06-132803c40897\") " pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:48.905563 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:48.905482 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" May 26 19:28:49.029465 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.029436 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86b7f78cf7-44k72"] May 26 19:28:49.031656 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:49.031631 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458fed78_e616_4a8a_bd06_132803c40897.slice/crio-4ee2125be40b0b3b99da737f0b2365a8b308645f0801adc0110e026311fa99b6 WatchSource:0}: Error finding container 4ee2125be40b0b3b99da737f0b2365a8b308645f0801adc0110e026311fa99b6: Status 404 returned error can't find the container with id 4ee2125be40b0b3b99da737f0b2365a8b308645f0801adc0110e026311fa99b6 May 26 19:28:49.205368 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.205330 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" event={"ID":"458fed78-e616-4a8a-bd06-132803c40897","Type":"ContainerStarted","Data":"4ee2125be40b0b3b99da737f0b2365a8b308645f0801adc0110e026311fa99b6"} May 26 19:28:49.613889 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.613800 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:28:49.617831 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.617811 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.620493 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620472 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 19:28:49.620628 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620542 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 19:28:49.620628 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620569 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2g85s\"" May 26 19:28:49.620628 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620590 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 19:28:49.620845 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620827 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 19:28:49.620961 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620878 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 19:28:49.621026 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620967 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 19:28:49.621026 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620975 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 19:28:49.621026 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.620999 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2mqar0ds04t9c\"" May 26 19:28:49.621203 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.621087 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 19:28:49.621464 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.621413 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 19:28:49.621571 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.621464 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 19:28:49.621571 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.621476 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 19:28:49.621571 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.621502 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 19:28:49.623101 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.623078 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 19:28:49.628459 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.628439 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:28:49.682898 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.682870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.682898 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.682901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683064 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.682930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683064 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.682981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683064 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683064 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config-out\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r4vl\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-kube-api-access-4r4vl\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683351 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683351 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683351 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683351 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683277 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683351 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683510 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.683510 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.683385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-web-config\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784441 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784404 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784452 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784494 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784517 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784554 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784581 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.784944 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784919 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785028 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.784998 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785086 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785032 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-web-config\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785134 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785083 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785134 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785114 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785228 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785160 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785228 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785188 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785228 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785217 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785241 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785282 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config-out\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785310 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r4vl\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-kube-api-access-4r4vl\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.785371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785361 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.786167 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.785550 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.786784 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.786755 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.787275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.787251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.787401 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.787316 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.787540 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.787514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.789082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.789029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.789082 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.789029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.790156 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.790116 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config-out\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.790237 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.790197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.790237 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.790197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.790774 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.790735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.791083 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.791029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.791254 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.791236 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.791939 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.791897 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.791939 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.791907 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-web-config\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.792754 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.792734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.793003 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.792975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.795243 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.795225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r4vl\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-kube-api-access-4r4vl\") pod \"prometheus-k8s-0\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:49.928534 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:49.928458 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:28:50.065975 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:50.065933 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:28:50.068118 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:28:50.068084 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda629e76c_cfa1_41f9_917c_1c4041e0eb56.slice/crio-afefce2e03d1bdc6d363653ce8777e1e21496412aeba8495d48d31d89527fc6a WatchSource:0}: Error finding container afefce2e03d1bdc6d363653ce8777e1e21496412aeba8495d48d31d89527fc6a: Status 404 returned error can't find the container with id afefce2e03d1bdc6d363653ce8777e1e21496412aeba8495d48d31d89527fc6a May 26 19:28:50.208660 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:50.208604 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"afefce2e03d1bdc6d363653ce8777e1e21496412aeba8495d48d31d89527fc6a"} May 26 19:28:52.215289 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:52.215255 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" exitCode=0 May 26 19:28:52.215761 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:52.215342 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} May 26 19:28:52.217331 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:52.217311 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" event={"ID":"458fed78-e616-4a8a-bd06-132803c40897","Type":"ContainerStarted","Data":"0f7651ea09548737feae0c9bc2d5e4ea630ac1833232af633a2537472e630456"} May 26 19:28:52.217396 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:52.217338 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" event={"ID":"458fed78-e616-4a8a-bd06-132803c40897","Type":"ContainerStarted","Data":"2717120f8ae0ebfc91941ce93b26f890a86006fc104517fe20fd4aad53efaad3"} May 26 19:28:52.217396 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:52.217347 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" event={"ID":"458fed78-e616-4a8a-bd06-132803c40897","Type":"ContainerStarted","Data":"f55a7ac22bd3530c4ff3788f3c7a1040ba788ac80c62956769251c0f7f1e98f2"} May 26 19:28:52.258719 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:52.258666 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86b7f78cf7-44k72" podStartSLOduration=1.590417355 podStartE2EDuration="4.2586526s" podCreationTimestamp="2026-05-26 19:28:48 +0000 UTC" firstStartedPulling="2026-05-26 19:28:49.033423788 +0000 UTC m=+190.048167263" lastFinishedPulling="2026-05-26 19:28:51.701659028 +0000 UTC m=+192.716402508" observedRunningTime="2026-05-26 19:28:52.257238371 +0000 UTC m=+193.271981871" watchObservedRunningTime="2026-05-26 19:28:52.2586526 +0000 UTC m=+193.273396096" May 26 19:28:54.916636 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:54.916571 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:28:54.917063 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:54.916658 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:28:55.227459 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:55.227427 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} May 26 19:28:56.235287 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:56.235235 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} May 26 19:28:57.167128 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.167103 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:28:57.167244 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.167147 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:28:57.241017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.240943 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} May 26 19:28:57.241017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.240978 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} May 26 19:28:57.241017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.240989 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} May 26 19:28:57.241017 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.240997 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerStarted","Data":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} May 26 19:28:57.267476 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:57.267419 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.378551324 podStartE2EDuration="8.26740311s" podCreationTimestamp="2026-05-26 19:28:49 +0000 UTC" firstStartedPulling="2026-05-26 19:28:50.070691984 +0000 UTC m=+191.085435465" lastFinishedPulling="2026-05-26 19:28:56.959543773 +0000 UTC m=+197.974287251" observedRunningTime="2026-05-26 19:28:57.265098092 +0000 UTC m=+198.279841625" watchObservedRunningTime="2026-05-26 19:28:57.26740311 +0000 UTC m=+198.282146648" May 26 19:28:59.928653 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:28:59.928604 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:29:04.915530 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:04.915494 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:04.915874 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:04.915545 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:29:05.262957 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:05.262925 2572 generic.go:358] "Generic (PLEG): container finished" podID="ed05dfac-c7b4-4686-b8e6-df8042fd4bd3" containerID="5b750eed996276e83ea0cfcb82d03138144947d986d4fa717c702b30ae498ce0" exitCode=0 May 26 19:29:05.263100 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:05.263000 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" event={"ID":"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3","Type":"ContainerDied","Data":"5b750eed996276e83ea0cfcb82d03138144947d986d4fa717c702b30ae498ce0"} May 26 19:29:05.263339 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:05.263326 2572 scope.go:117] "RemoveContainer" containerID="5b750eed996276e83ea0cfcb82d03138144947d986d4fa717c702b30ae498ce0" May 26 19:29:06.267504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:06.267468 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7kwtj" event={"ID":"ed05dfac-c7b4-4686-b8e6-df8042fd4bd3","Type":"ContainerStarted","Data":"97804118e9b93051a0ca8d4cb5d8aad2333e6987e2a4dea9576a5b3a631c6d36"} May 26 19:29:07.167125 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:07.167094 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:07.167293 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:07.167144 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:29:09.284247 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:09.284220 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-q8qpr_e1ed8051-6098-4124-8d0b-eefd559e2bc9/cluster-monitoring-operator/0.log" May 26 19:29:11.682528 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:11.682495 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkdg6_8195b26e-a37a-41d9-9619-f8dc51e69cd1/init-textfile/0.log" May 26 19:29:11.883510 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:11.883482 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkdg6_8195b26e-a37a-41d9-9619-f8dc51e69cd1/node-exporter/0.log" May 26 19:29:12.084317 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:12.084289 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkdg6_8195b26e-a37a-41d9-9619-f8dc51e69cd1/kube-rbac-proxy/0.log" May 26 19:29:12.883079 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:12.883051 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/init-config-reloader/0.log" May 26 19:29:13.084366 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:13.084336 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/prometheus/0.log" May 26 19:29:13.283300 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:13.283270 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/config-reloader/0.log" May 26 19:29:13.483074 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:13.483042 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/thanos-sidecar/0.log" May 26 19:29:13.682930 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:13.682852 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/kube-rbac-proxy-web/0.log" May 26 19:29:13.882558 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:13.882532 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/kube-rbac-proxy/0.log" May 26 19:29:14.083118 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.083091 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a629e76c-cfa1-41f9-917c-1c4041e0eb56/kube-rbac-proxy-thanos/0.log" May 26 19:29:14.683979 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.683946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-jvl82_658fa14c-e5e3-4b48-89fc-086c227437ab/prometheus-operator-admission-webhook/0.log" May 26 19:29:14.885239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.885214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b7f78cf7-44k72_458fed78-e616-4a8a-bd06-132803c40897/telemeter-client/0.log" May 26 19:29:14.915359 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.915324 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:14.915494 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.915378 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:29:14.915494 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.915416 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:29:14.915883 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.915844 2572 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"20d798a018d6cf2110e7da783a7321c49f71e583422f5d384a8163c826290f4c"} pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" containerMessage="Container registry failed liveness probe, will be restarted" May 26 19:29:14.919059 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.919034 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:14.919189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:14.919076 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:29:15.082503 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:15.082476 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b7f78cf7-44k72_458fed78-e616-4a8a-bd06-132803c40897/reload/0.log" May 26 19:29:15.283369 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:15.283333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b7f78cf7-44k72_458fed78-e616-4a8a-bd06-132803c40897/kube-rbac-proxy/0.log" May 26 19:29:16.883513 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:16.883485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:29:17.084055 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:17.084022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/2.log" May 26 19:29:19.282739 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:19.282713 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmlqf_9981d3b7-819a-4992-8268-264375709664/dns-node-resolver/0.log" May 26 19:29:19.683338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:19.683266 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9d8c474b-xqwjk_803b66fd-4b74-4ba0-9e9b-8525abe4d5ea/registry/0.log" May 26 19:29:20.082424 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:20.082391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7mw7d_11bc48b0-ed2b-495b-89c9-3dddad119bbb/node-ca/0.log" May 26 19:29:20.688791 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:20.688766 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79dc7dd876-xpmtj_f101134a-e37c-4bc0-9bbc-aef5294cb842/router/0.log" May 26 19:29:24.919165 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:24.919134 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:24.919662 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:24.919183 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:29:34.919415 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:34.919376 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:34.919813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:34.919429 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:29:39.934384 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:39.934330 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" containerID="cri-o://20d798a018d6cf2110e7da783a7321c49f71e583422f5d384a8163c826290f4c" gracePeriod=30 May 26 19:29:41.364302 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:41.364214 2572 generic.go:358] "Generic (PLEG): container finished" podID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerID="20d798a018d6cf2110e7da783a7321c49f71e583422f5d384a8163c826290f4c" exitCode=0 May 26 19:29:41.364717 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:41.364295 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" event={"ID":"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea","Type":"ContainerDied","Data":"20d798a018d6cf2110e7da783a7321c49f71e583422f5d384a8163c826290f4c"} May 26 19:29:41.364717 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:41.364339 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" event={"ID":"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea","Type":"ContainerStarted","Data":"fda507a250d5eac31f9bfef4e8eb9d96a0652b305d3b018fc935a430c209b8db"} May 26 19:29:41.364717 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:41.364376 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:29:49.929637 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:49.929573 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:29:49.945899 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:49.945871 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:29:50.402255 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:50.402218 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:29:50.421174 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:50.421142 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:29:50.423378 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:50.423352 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7577541e-b896-4245-952d-678b254cb153-metrics-certs\") pod \"network-metrics-daemon-94xc5\" (UID: \"7577541e-b896-4245-952d-678b254cb153\") " pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:29:50.714034 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:50.714004 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9trh\"" May 26 19:29:50.721231 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:50.721211 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94xc5" May 26 19:29:50.839506 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:50.839472 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94xc5"] May 26 19:29:50.842770 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:29:50.842732 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7577541e_b896_4245_952d_678b254cb153.slice/crio-34bbd9ecb1c1d2b39e8774913681e02d41089b4ce1df11959958ea5625c29f2b WatchSource:0}: Error finding container 34bbd9ecb1c1d2b39e8774913681e02d41089b4ce1df11959958ea5625c29f2b: Status 404 returned error can't find the container with id 34bbd9ecb1c1d2b39e8774913681e02d41089b4ce1df11959958ea5625c29f2b May 26 19:29:51.390323 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:51.390283 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94xc5" event={"ID":"7577541e-b896-4245-952d-678b254cb153","Type":"ContainerStarted","Data":"34bbd9ecb1c1d2b39e8774913681e02d41089b4ce1df11959958ea5625c29f2b"} May 26 19:29:52.394756 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:52.394723 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94xc5" event={"ID":"7577541e-b896-4245-952d-678b254cb153","Type":"ContainerStarted","Data":"ebe0f4ae99d51384e99733912a426aaec68e3d13c976108818420f43365da219"} May 26 19:29:52.394756 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:52.394757 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94xc5" event={"ID":"7577541e-b896-4245-952d-678b254cb153","Type":"ContainerStarted","Data":"5378e08347f9f7509fb22c54371f0c7781c082beb747a68373a276fc3cccec11"} May 26 19:29:52.411074 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:52.411027 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-94xc5" podStartSLOduration=252.393491387 podStartE2EDuration="4m13.411013009s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:29:50.844695839 +0000 UTC m=+251.859439314" lastFinishedPulling="2026-05-26 19:29:51.862217458 +0000 UTC m=+252.876960936" observedRunningTime="2026-05-26 19:29:52.4098226 +0000 UTC m=+253.424566104" watchObservedRunningTime="2026-05-26 19:29:52.411013009 +0000 UTC m=+253.425756506" May 26 19:29:54.916368 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:54.916335 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:29:54.916777 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:29:54.916386 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:02.371279 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:02.371200 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:30:02.371279 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:02.371257 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:04.915808 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:04.915772 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:30:04.916169 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:04.915838 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:07.922521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.922488 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:30:07.922955 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.922918 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="prometheus" containerID="cri-o://b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" gracePeriod=600 May 26 19:30:07.923107 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.922938 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy" containerID="cri-o://92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" gracePeriod=600 May 26 19:30:07.923107 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.922990 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-thanos" containerID="cri-o://15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" gracePeriod=600 May 26 19:30:07.923107 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.923005 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-web" containerID="cri-o://4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" gracePeriod=600 May 26 19:30:07.923107 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.923005 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="thanos-sidecar" containerID="cri-o://9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" gracePeriod=600 May 26 19:30:07.923322 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:07.923014 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="config-reloader" containerID="cri-o://f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" gracePeriod=600 May 26 19:30:08.174160 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.174103 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.273357 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273325 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config-out\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273366 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-kube-rbac-proxy\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273392 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r4vl\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-kube-api-access-4r4vl\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273442 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-kubelet-serving-ca-bundle\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273472 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273521 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273499 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-metrics-client-certs\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273525 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273565 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-trusted-ca-bundle\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273604 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-metrics-client-ca\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273658 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-rulefiles-0\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273683 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-thanos-prometheus-http-client-file\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273710 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-web-config\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273755 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-grpc-tls\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273782 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-tls-assets\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.273824 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273813 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273858 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-tls\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273895 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-db\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273890 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.273931 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-serving-certs-ca-bundle\") pod \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\" (UID: \"a629e76c-cfa1-41f9-917c-1c4041e0eb56\") " May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.274032 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.274203 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.274275 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.274224 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-metrics-client-ca\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.274645 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.274530 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:08.274645 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.274546 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:08.276333 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.276296 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:08.276453 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.276370 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:30:08.276721 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.276682 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.277063 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277034 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.277173 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277084 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config" (OuterVolumeSpecName: "config") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.277173 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277162 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-kube-api-access-4r4vl" (OuterVolumeSpecName: "kube-api-access-4r4vl") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "kube-api-access-4r4vl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:30:08.277382 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277358 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config-out" (OuterVolumeSpecName: "config-out") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:30:08.277455 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277439 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:30:08.277786 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277760 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.277865 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277787 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.278000 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.277984 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.278349 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.278333 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.278681 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.278607 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.288392 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.288367 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-web-config" (OuterVolumeSpecName: "web-config") pod "a629e76c-cfa1-41f9-917c-1c4041e0eb56" (UID: "a629e76c-cfa1-41f9-917c-1c4041e0eb56"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:08.375136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375086 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375127 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-metrics-client-certs\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375140 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375149 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375160 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375171 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375181 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-web-config\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375190 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-grpc-tls\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375198 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-tls-assets\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375206 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375214 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375225 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-prometheus-k8s-db\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375233 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a629e76c-cfa1-41f9-917c-1c4041e0eb56-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375242 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a629e76c-cfa1-41f9-917c-1c4041e0eb56-config-out\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375251 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a629e76c-cfa1-41f9-917c-1c4041e0eb56-secret-kube-rbac-proxy\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.375468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.375259 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r4vl\" (UniqueName: \"kubernetes.io/projected/a629e76c-cfa1-41f9-917c-1c4041e0eb56-kube-api-access-4r4vl\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:30:08.437747 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437717 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" exitCode=0 May 26 19:30:08.437747 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437743 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" exitCode=0 May 26 19:30:08.437747 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437750 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" exitCode=0 May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437755 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" exitCode=0 May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437762 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" exitCode=0 May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437769 2572 generic.go:358] "Generic (PLEG): container finished" podID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" exitCode=0 May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437788 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437817 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437827 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437828 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437838 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437855 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437864 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437873 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a629e76c-cfa1-41f9-917c-1c4041e0eb56","Type":"ContainerDied","Data":"afefce2e03d1bdc6d363653ce8777e1e21496412aeba8495d48d31d89527fc6a"} May 26 19:30:08.437968 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.437894 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.445343 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.445211 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.451918 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.451899 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.457896 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.457871 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.460718 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.460697 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:30:08.465077 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.465058 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:30:08.465485 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.465459 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.471430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.471409 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.477626 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.477600 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.483569 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.483551 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.483838 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.483820 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.483894 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.483848 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} err="failed to get container status \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" May 26 19:30:08.483894 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.483871 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.484115 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.484097 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.484163 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484120 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} err="failed to get container status \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" May 26 19:30:08.484163 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484136 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.484326 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.484311 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.484361 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484330 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} err="failed to get container status \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" May 26 19:30:08.484361 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484343 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.484547 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.484531 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.484585 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484549 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} err="failed to get container status \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" May 26 19:30:08.484585 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484562 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.484779 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.484762 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.484823 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484782 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} err="failed to get container status \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" May 26 19:30:08.484823 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.484794 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.485005 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.484991 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.485047 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485008 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} err="failed to get container status \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" May 26 19:30:08.485047 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485020 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.485223 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:08.485203 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.485270 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485225 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} err="failed to get container status \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" May 26 19:30:08.485270 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485235 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.485432 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485410 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} err="failed to get container status \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" May 26 19:30:08.485469 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485434 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.485681 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485601 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} err="failed to get container status \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" May 26 19:30:08.485681 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485629 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.485814 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485797 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} err="failed to get container status \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" May 26 19:30:08.485857 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.485815 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.486047 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486032 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} err="failed to get container status \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" May 26 19:30:08.486085 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486048 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.486237 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486219 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} err="failed to get container status \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" May 26 19:30:08.486282 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486236 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.486441 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486426 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} err="failed to get container status \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" May 26 19:30:08.486486 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486442 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.486645 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486605 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} err="failed to get container status \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" May 26 19:30:08.486697 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486646 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.486864 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486849 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} err="failed to get container status \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" May 26 19:30:08.486864 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.486863 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.487054 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487032 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} err="failed to get container status \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" May 26 19:30:08.487094 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487056 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.487238 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487222 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} err="failed to get container status \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" May 26 19:30:08.487238 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487237 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.487455 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487439 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} err="failed to get container status \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" May 26 19:30:08.487508 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487455 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.487607 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487593 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} err="failed to get container status \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" May 26 19:30:08.487672 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487607 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.487780 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487763 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} err="failed to get container status \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" May 26 19:30:08.487823 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487782 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.487980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487965 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} err="failed to get container status \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" May 26 19:30:08.488024 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.487979 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.488160 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488143 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} err="failed to get container status \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" May 26 19:30:08.488200 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488161 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.488364 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488346 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} err="failed to get container status \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" May 26 19:30:08.488364 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488363 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.488533 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488517 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} err="failed to get container status \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" May 26 19:30:08.488573 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488534 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.488736 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488717 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} err="failed to get container status \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" May 26 19:30:08.488736 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488735 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.488941 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488915 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} err="failed to get container status \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" May 26 19:30:08.488941 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.488942 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.489155 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489137 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} err="failed to get container status \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" May 26 19:30:08.489155 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489154 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.489421 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489396 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} err="failed to get container status \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" May 26 19:30:08.489421 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489421 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.489716 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489691 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} err="failed to get container status \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" May 26 19:30:08.489716 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489715 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.490020 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.489998 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} err="failed to get container status \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" May 26 19:30:08.490140 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490021 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.490417 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490392 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} err="failed to get container status \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" May 26 19:30:08.490498 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490416 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.490688 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490668 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} err="failed to get container status \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" May 26 19:30:08.490760 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490687 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.490934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490903 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} err="failed to get container status \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" May 26 19:30:08.490934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.490924 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.491111 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491092 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:30:08.491188 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491156 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} err="failed to get container status \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" May 26 19:30:08.491232 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491192 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.491368 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491352 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="prometheus" May 26 19:30:08.491368 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491369 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="prometheus" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491388 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491397 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491414 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-web" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491423 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-web" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491419 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} err="failed to get container status \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491435 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="config-reloader" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491439 2572 scope.go:117] "RemoveContainer" containerID="15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491444 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="config-reloader" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491455 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-thanos" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491465 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-thanos" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491476 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="thanos-sidecar" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491484 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="thanos-sidecar" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491498 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="init-config-reloader" May 26 19:30:08.491520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491506 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="init-config-reloader" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491574 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="config-reloader" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491586 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-thanos" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491596 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="prometheus" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491605 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy-web" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491640 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="thanos-sidecar" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491651 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" containerName="kube-rbac-proxy" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491639 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241"} err="failed to get container status \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": rpc error: code = NotFound desc = could not find container \"15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241\": container with ID starting with 15c228dd3965d61eb7020b8a7ebec3a686ce103a4def0323dc6abb90bec6c241 not found: ID does not exist" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491743 2572 scope.go:117] "RemoveContainer" containerID="92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491957 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450"} err="failed to get container status \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": rpc error: code = NotFound desc = could not find container \"92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450\": container with ID starting with 92ada4203afe3df642998f63d3eed05d8fea831de58639c4835f2ae093eb7450 not found: ID does not exist" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.491978 2572 scope.go:117] "RemoveContainer" containerID="4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492223 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8"} err="failed to get container status \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": rpc error: code = NotFound desc = could not find container \"4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8\": container with ID starting with 4e29fe3e8cd960b998ffc5b855dda0994f05d27b50c43d9e0d6de7c278693fd8 not found: ID does not exist" May 26 19:30:08.492411 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492245 2572 scope.go:117] "RemoveContainer" containerID="9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4" May 26 19:30:08.492961 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492475 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4"} err="failed to get container status \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": rpc error: code = NotFound desc = could not find container \"9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4\": container with ID starting with 9eba7880ff52eb425727fc1e720d2431ec4cf5e3b4cdf70de3e38613a78e72d4 not found: ID does not exist" May 26 19:30:08.492961 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492492 2572 scope.go:117] "RemoveContainer" containerID="f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe" May 26 19:30:08.492961 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492767 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe"} err="failed to get container status \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": rpc error: code = NotFound desc = could not find container \"f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe\": container with ID starting with f160a2544fb1294d8cc459e61b7caae26e3d37ee114527d052250be333ddcdfe not found: ID does not exist" May 26 19:30:08.492961 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492783 2572 scope.go:117] "RemoveContainer" containerID="b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a" May 26 19:30:08.493145 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492982 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a"} err="failed to get container status \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": rpc error: code = NotFound desc = could not find container \"b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a\": container with ID starting with b4b55c733ca775a31601e846f50d78bd84eda46eab87af4fe64f2d94ce52de3a not found: ID does not exist" May 26 19:30:08.493145 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.492995 2572 scope.go:117] "RemoveContainer" containerID="05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80" May 26 19:30:08.493212 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.493184 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80"} err="failed to get container status \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": rpc error: code = NotFound desc = could not find container \"05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80\": container with ID starting with 05611b3d59d0d38c9cc3eae734cbcc683b390628c4721b1d51940da5ca4ccb80 not found: ID does not exist" May 26 19:30:08.497349 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.497331 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.499867 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.499850 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 19:30:08.499935 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.499866 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 19:30:08.500356 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500189 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2g85s\"" May 26 19:30:08.500356 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500215 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 19:30:08.500356 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500222 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 19:30:08.500356 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500262 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 19:30:08.500356 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500325 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 19:30:08.500356 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500338 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 19:30:08.500600 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500555 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 19:30:08.500600 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.500587 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 19:30:08.501365 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.501033 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 19:30:08.501365 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.501240 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 19:30:08.501365 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.501233 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2mqar0ds04t9c\"" May 26 19:30:08.507378 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.506465 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 19:30:08.508504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.508483 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 19:30:08.510416 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.510394 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:30:08.577282 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577282 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577459 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c765bdf4-10ad-4533-905f-c331be72b7bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.577769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.578070 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c765bdf4-10ad-4533-905f-c331be72b7bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.578070 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.578070 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-config\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.578070 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.577910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ppt\" (UniqueName: \"kubernetes.io/projected/c765bdf4-10ad-4533-905f-c331be72b7bf-kube-api-access-t8ppt\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678490 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678455 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678670 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678496 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678670 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678519 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678670 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678548 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678670 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678587 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678670 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678646 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678670 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678718 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678743 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678768 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678812 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678835 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678867 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c765bdf4-10ad-4533-905f-c331be72b7bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678894 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.678925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678919 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c765bdf4-10ad-4533-905f-c331be72b7bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.679344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678952 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.679344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.678986 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-config\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.679344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.679016 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ppt\" (UniqueName: \"kubernetes.io/projected/c765bdf4-10ad-4533-905f-c331be72b7bf-kube-api-access-t8ppt\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.679344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.679234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.679891 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.679860 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.681987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.681638 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.681987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.681700 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.681987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.681752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.681987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.681798 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.681987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.681936 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.681987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.681970 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.682376 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.682178 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.682376 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.682331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.682481 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.682408 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c765bdf4-10ad-4533-905f-c331be72b7bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.682538 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.682506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.683033 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.683005 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.683861 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.683831 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c765bdf4-10ad-4533-905f-c331be72b7bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.683973 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.683955 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-config\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.684315 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.684295 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c765bdf4-10ad-4533-905f-c331be72b7bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.684557 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.684536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c765bdf4-10ad-4533-905f-c331be72b7bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.686156 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.686136 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ppt\" (UniqueName: \"kubernetes.io/projected/c765bdf4-10ad-4533-905f-c331be72b7bf-kube-api-access-t8ppt\") pod \"prometheus-k8s-0\" (UID: \"c765bdf4-10ad-4533-905f-c331be72b7bf\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.811668 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.811561 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:08.940850 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:08.940734 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 19:30:08.943508 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:30:08.943482 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc765bdf4_10ad_4533_905f_c331be72b7bf.slice/crio-0a8f882560d5fdd2195062a4444f92e949f6237fafd5a437fa0cf13ef663f756 WatchSource:0}: Error finding container 0a8f882560d5fdd2195062a4444f92e949f6237fafd5a437fa0cf13ef663f756: Status 404 returned error can't find the container with id 0a8f882560d5fdd2195062a4444f92e949f6237fafd5a437fa0cf13ef663f756 May 26 19:30:09.442414 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:09.442378 2572 generic.go:358] "Generic (PLEG): container finished" podID="c765bdf4-10ad-4533-905f-c331be72b7bf" containerID="a8a5725ef4f30856ed441d0380acf2696849cc8eeca8af7878d7485f191c329f" exitCode=0 May 26 19:30:09.442600 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:09.442426 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerDied","Data":"a8a5725ef4f30856ed441d0380acf2696849cc8eeca8af7878d7485f191c329f"} May 26 19:30:09.442600 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:09.442444 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"0a8f882560d5fdd2195062a4444f92e949f6237fafd5a437fa0cf13ef663f756"} May 26 19:30:09.617507 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:09.617485 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a629e76c-cfa1-41f9-917c-1c4041e0eb56" path="/var/lib/kubelet/pods/a629e76c-cfa1-41f9-917c-1c4041e0eb56/volumes" May 26 19:30:10.447914 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.447878 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"ffdf35f2b1d35daada59b4ba4e123542832bb28868bbad3f47834f0064f06ae6"} May 26 19:30:10.447914 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.447918 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"38a8e5862d03d1f9478604ebe00d971ab97d72de1dc752e22c8821502078a828"} May 26 19:30:10.448313 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.447927 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"28a7d91c6d629e264306f54429d0b954d27485d32653049f5d7eeaa149946aee"} May 26 19:30:10.448313 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.447936 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"71541fbf1fa1ff51e78af5324dcde9c0a7d4d4c1eefc62c3ef3bd924c637d042"} May 26 19:30:10.448313 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.447943 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"e13fcb516d81a0188b2fc1862e7c448e2a4381763973303ccf153b848a8df055"} May 26 19:30:10.448313 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.447951 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c765bdf4-10ad-4533-905f-c331be72b7bf","Type":"ContainerStarted","Data":"5a76b8696c4af87dc66f096eb17aee777a5f576406ef3b12015d6fe82abe705c"} May 26 19:30:10.476630 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:10.476570 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.476555646 podStartE2EDuration="2.476555646s" podCreationTimestamp="2026-05-26 19:30:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:30:10.474198255 +0000 UTC m=+271.488941754" watchObservedRunningTime="2026-05-26 19:30:10.476555646 +0000 UTC m=+271.491299142" May 26 19:30:12.371524 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:12.371487 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:30:12.371902 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:12.371560 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:13.812373 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:13.812329 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:30:14.915858 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:14.915830 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:30:14.916196 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:14.915876 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:14.916196 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:14.915911 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:30:14.916395 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:14.916373 2572 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"fda507a250d5eac31f9bfef4e8eb9d96a0652b305d3b018fc935a430c209b8db"} pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" containerMessage="Container registry failed liveness probe, will be restarted" May 26 19:30:14.919978 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:14.919952 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:30:14.920085 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:14.919995 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:19.103796 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:30:19.103749 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-smpfm" podUID="ce5dc346-b4ea-4319-8fc4-644e2d102418" May 26 19:30:19.472653 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:19.472606 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smpfm" May 26 19:30:22.807273 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.807234 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:30:22.807640 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.807293 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:30:22.809599 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.809573 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce5dc346-b4ea-4319-8fc4-644e2d102418-metrics-tls\") pod \"dns-default-smpfm\" (UID: \"ce5dc346-b4ea-4319-8fc4-644e2d102418\") " pod="openshift-dns/dns-default-smpfm" May 26 19:30:22.809731 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.809653 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b84a051-b9e7-400c-887f-851052532150-cert\") pod \"ingress-canary-ckdkh\" (UID: \"1b84a051-b9e7-400c-887f-851052532150\") " pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:30:22.813865 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.813841 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhp6d\"" May 26 19:30:22.820962 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.820943 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckdkh" May 26 19:30:22.941888 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:22.941856 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckdkh"] May 26 19:30:22.944992 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:30:22.944957 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b84a051_b9e7_400c_887f_851052532150.slice/crio-edb61a4c16b5b37afb1d334d46c7265228db46ae3056d89eaea560b7210110bf WatchSource:0}: Error finding container edb61a4c16b5b37afb1d334d46c7265228db46ae3056d89eaea560b7210110bf: Status 404 returned error can't find the container with id edb61a4c16b5b37afb1d334d46c7265228db46ae3056d89eaea560b7210110bf May 26 19:30:23.075964 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:23.075879 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtv8f\"" May 26 19:30:23.083946 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:23.083926 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smpfm" May 26 19:30:23.207047 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:23.207025 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smpfm"] May 26 19:30:23.209498 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:30:23.209473 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5dc346_b4ea_4319_8fc4_644e2d102418.slice/crio-03477f9f200f31e3802922c11162cfdf1cc4fdf409a7edeb86a0ff6cffed1807 WatchSource:0}: Error finding container 03477f9f200f31e3802922c11162cfdf1cc4fdf409a7edeb86a0ff6cffed1807: Status 404 returned error can't find the container with id 03477f9f200f31e3802922c11162cfdf1cc4fdf409a7edeb86a0ff6cffed1807 May 26 19:30:23.491095 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:23.491056 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smpfm" event={"ID":"ce5dc346-b4ea-4319-8fc4-644e2d102418","Type":"ContainerStarted","Data":"03477f9f200f31e3802922c11162cfdf1cc4fdf409a7edeb86a0ff6cffed1807"} May 26 19:30:23.492175 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:23.492148 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckdkh" event={"ID":"1b84a051-b9e7-400c-887f-851052532150","Type":"ContainerStarted","Data":"edb61a4c16b5b37afb1d334d46c7265228db46ae3056d89eaea560b7210110bf"} May 26 19:30:24.920369 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:24.920322 2572 patch_prober.go:28] interesting pod/image-registry-5b9d8c474b-xqwjk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 19:30:24.920782 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:24.920377 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:30:25.500120 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:25.500081 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smpfm" event={"ID":"ce5dc346-b4ea-4319-8fc4-644e2d102418","Type":"ContainerStarted","Data":"bd5672fb7a8a336e18e93e65702515a1a53dd0a9c3f784934f16e91d23ab2edf"} May 26 19:30:25.500291 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:25.500130 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smpfm" event={"ID":"ce5dc346-b4ea-4319-8fc4-644e2d102418","Type":"ContainerStarted","Data":"53762f520e05293da19fa54bc62e2832196fd89dc640b14dbb93bc81f6d3f571"} May 26 19:30:25.500291 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:25.500211 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-smpfm" May 26 19:30:25.501330 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:25.501312 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckdkh" event={"ID":"1b84a051-b9e7-400c-887f-851052532150","Type":"ContainerStarted","Data":"c8722dd28e8daee1a0ce4a6d577a46f60497f6fa8c05eb6620bd6f6dfc3412b1"} May 26 19:30:25.517782 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:25.517734 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-smpfm" podStartSLOduration=251.75487264 podStartE2EDuration="4m13.517722011s" podCreationTimestamp="2026-05-26 19:26:12 +0000 UTC" firstStartedPulling="2026-05-26 19:30:23.211280538 +0000 UTC m=+284.226024017" lastFinishedPulling="2026-05-26 19:30:24.97412991 +0000 UTC m=+285.988873388" observedRunningTime="2026-05-26 19:30:25.515699924 +0000 UTC m=+286.530443420" watchObservedRunningTime="2026-05-26 19:30:25.517722011 +0000 UTC m=+286.532465509" May 26 19:30:25.530490 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:25.530446 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ckdkh" podStartSLOduration=251.501599427 podStartE2EDuration="4m13.530433571s" podCreationTimestamp="2026-05-26 19:26:12 +0000 UTC" firstStartedPulling="2026-05-26 19:30:22.94676325 +0000 UTC m=+283.961506726" lastFinishedPulling="2026-05-26 19:30:24.975597395 +0000 UTC m=+285.990340870" observedRunningTime="2026-05-26 19:30:25.52889725 +0000 UTC m=+286.543640746" watchObservedRunningTime="2026-05-26 19:30:25.530433571 +0000 UTC m=+286.545177068" May 26 19:30:34.920406 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:34.920377 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:30:35.506770 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:35.506741 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-smpfm" May 26 19:30:39.499825 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:39.499793 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:30:39.500460 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:39.500381 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:30:39.517324 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:39.517279 2572 kubelet.go:1628] "Image garbage collection succeeded" May 26 19:30:39.934143 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:39.934049 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" podUID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerName="registry" containerID="cri-o://fda507a250d5eac31f9bfef4e8eb9d96a0652b305d3b018fc935a430c209b8db" gracePeriod=30 May 26 19:30:41.050867 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:41.050847 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:30:41.549504 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:41.549469 2572 generic.go:358] "Generic (PLEG): container finished" podID="803b66fd-4b74-4ba0-9e9b-8525abe4d5ea" containerID="fda507a250d5eac31f9bfef4e8eb9d96a0652b305d3b018fc935a430c209b8db" exitCode=0 May 26 19:30:41.549772 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:41.549556 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" event={"ID":"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea","Type":"ContainerDied","Data":"fda507a250d5eac31f9bfef4e8eb9d96a0652b305d3b018fc935a430c209b8db"} May 26 19:30:41.549772 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:41.549594 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:30:41.549772 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:41.549603 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" event={"ID":"803b66fd-4b74-4ba0-9e9b-8525abe4d5ea","Type":"ContainerStarted","Data":"6559872c18cd995a7eee4704c64625955ff2633f9c30740b0f0f3a5114747bbd"} May 26 19:30:41.549772 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:30:41.549635 2572 scope.go:117] "RemoveContainer" containerID="20d798a018d6cf2110e7da783a7321c49f71e583422f5d384a8163c826290f4c" May 26 19:31:02.557371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:31:02.557340 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9d8c474b-xqwjk" May 26 19:31:08.811980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:31:08.811943 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:31:08.827254 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:31:08.827229 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:31:09.643355 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:31:09.643328 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 19:35:18.630585 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.630550 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-h44l2"] May 26 19:35:18.633562 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.633544 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.636100 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.636078 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 19:35:18.641428 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.641407 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h44l2"] May 26 19:35:18.746942 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.746912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35659880-b528-4be0-a5c0-7c5aee8400c9-kubelet-config\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.747111 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.747018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35659880-b528-4be0-a5c0-7c5aee8400c9-original-pull-secret\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.747111 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.747040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35659880-b528-4be0-a5c0-7c5aee8400c9-dbus\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.847972 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.847932 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35659880-b528-4be0-a5c0-7c5aee8400c9-original-pull-secret\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.847972 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.847972 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35659880-b528-4be0-a5c0-7c5aee8400c9-dbus\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.848170 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.847995 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35659880-b528-4be0-a5c0-7c5aee8400c9-kubelet-config\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.848170 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.848102 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35659880-b528-4be0-a5c0-7c5aee8400c9-kubelet-config\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.848170 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.848155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35659880-b528-4be0-a5c0-7c5aee8400c9-dbus\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.850124 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.850097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35659880-b528-4be0-a5c0-7c5aee8400c9-original-pull-secret\") pod \"global-pull-secret-syncer-h44l2\" (UID: \"35659880-b528-4be0-a5c0-7c5aee8400c9\") " pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:18.942662 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:18.942634 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h44l2" May 26 19:35:19.068047 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:19.067858 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h44l2"] May 26 19:35:19.070843 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:35:19.070808 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35659880_b528_4be0_a5c0_7c5aee8400c9.slice/crio-1e5b7ebb7d4dccfeff42ccae63c14074ed15441e1fd62526b4d8bf8fd564532d WatchSource:0}: Error finding container 1e5b7ebb7d4dccfeff42ccae63c14074ed15441e1fd62526b4d8bf8fd564532d: Status 404 returned error can't find the container with id 1e5b7ebb7d4dccfeff42ccae63c14074ed15441e1fd62526b4d8bf8fd564532d May 26 19:35:19.304268 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:19.304181 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h44l2" event={"ID":"35659880-b528-4be0-a5c0-7c5aee8400c9","Type":"ContainerStarted","Data":"1e5b7ebb7d4dccfeff42ccae63c14074ed15441e1fd62526b4d8bf8fd564532d"} May 26 19:35:23.317581 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:23.317543 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h44l2" event={"ID":"35659880-b528-4be0-a5c0-7c5aee8400c9","Type":"ContainerStarted","Data":"ddcd98d3abd63bebfd7e817ea78bf62ecae09fcdbfefcc6652c28d6c25baff51"} May 26 19:35:23.332944 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:23.332898 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h44l2" podStartSLOduration=1.485668669 podStartE2EDuration="5.332883717s" podCreationTimestamp="2026-05-26 19:35:18 +0000 UTC" firstStartedPulling="2026-05-26 19:35:19.072475952 +0000 UTC m=+580.087219427" lastFinishedPulling="2026-05-26 19:35:22.919690981 +0000 UTC m=+583.934434475" observedRunningTime="2026-05-26 19:35:23.332028362 +0000 UTC m=+584.346771861" watchObservedRunningTime="2026-05-26 19:35:23.332883717 +0000 UTC m=+584.347627213" May 26 19:35:39.530870 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:39.530844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:35:39.531258 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:35:39.530892 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:36:52.030311 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.030279 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98"] May 26 19:36:52.032502 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.032481 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.035843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.035807 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 26 19:36:52.036193 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.036177 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 26 19:36:52.036288 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.036253 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 26 19:36:52.036354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.036293 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-krg4l\"" May 26 19:36:52.036354 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.036300 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 26 19:36:52.049804 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.049778 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98"] May 26 19:36:52.127539 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.127497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d07c3100-d5a2-4b7e-b44a-14758492e43a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.127749 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.127556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d07c3100-d5a2-4b7e-b44a-14758492e43a-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.127749 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.127652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfd4\" (UniqueName: \"kubernetes.io/projected/d07c3100-d5a2-4b7e-b44a-14758492e43a-kube-api-access-2pfd4\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.228846 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.228811 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d07c3100-d5a2-4b7e-b44a-14758492e43a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.229009 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.228860 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d07c3100-d5a2-4b7e-b44a-14758492e43a-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.229009 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.228976 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfd4\" (UniqueName: \"kubernetes.io/projected/d07c3100-d5a2-4b7e-b44a-14758492e43a-kube-api-access-2pfd4\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.231426 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.231394 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d07c3100-d5a2-4b7e-b44a-14758492e43a-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.231520 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.231403 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d07c3100-d5a2-4b7e-b44a-14758492e43a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.237296 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.237275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfd4\" (UniqueName: \"kubernetes.io/projected/d07c3100-d5a2-4b7e-b44a-14758492e43a-kube-api-access-2pfd4\") pod \"opendatahub-operator-controller-manager-94b8b45bb-crq98\" (UID: \"d07c3100-d5a2-4b7e-b44a-14758492e43a\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.343835 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.343749 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:52.474933 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.474897 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98"] May 26 19:36:52.477906 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:36:52.477875 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07c3100_d5a2_4b7e_b44a_14758492e43a.slice/crio-49357e07262af42276ffac4f1e5be487a5d204f3cfdfdb087e6fba0270aa02ca WatchSource:0}: Error finding container 49357e07262af42276ffac4f1e5be487a5d204f3cfdfdb087e6fba0270aa02ca: Status 404 returned error can't find the container with id 49357e07262af42276ffac4f1e5be487a5d204f3cfdfdb087e6fba0270aa02ca May 26 19:36:52.479639 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.479591 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:36:52.572191 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:52.572154 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" event={"ID":"d07c3100-d5a2-4b7e-b44a-14758492e43a","Type":"ContainerStarted","Data":"49357e07262af42276ffac4f1e5be487a5d204f3cfdfdb087e6fba0270aa02ca"} May 26 19:36:55.583499 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:55.583468 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" event={"ID":"d07c3100-d5a2-4b7e-b44a-14758492e43a","Type":"ContainerStarted","Data":"fb8eb40a88a6bb63d19608b6f39f1d910d8c80107a313d2ee92e89004cad2b25"} May 26 19:36:55.583904 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:55.583522 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:36:55.606624 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:36:55.606564 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" podStartSLOduration=2.142622101 podStartE2EDuration="4.606549546s" podCreationTimestamp="2026-05-26 19:36:51 +0000 UTC" firstStartedPulling="2026-05-26 19:36:52.479805802 +0000 UTC m=+673.494549283" lastFinishedPulling="2026-05-26 19:36:54.94373324 +0000 UTC m=+675.958476728" observedRunningTime="2026-05-26 19:36:55.604341874 +0000 UTC m=+676.619085371" watchObservedRunningTime="2026-05-26 19:36:55.606549546 +0000 UTC m=+676.621293042" May 26 19:37:06.591818 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:06.591786 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-crq98" May 26 19:37:08.636514 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.636480 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5"] May 26 19:37:08.639324 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.639304 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.644540 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:08.644514 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" May 26 19:37:08.644673 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:08.644566 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"lws-manager-config\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" May 26 19:37:08.644673 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:08.644593 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-cert\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" May 26 19:37:08.645568 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:08.645545 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"lws-controller-manager-dockercfg-hk8q8\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hk8q8\"" type="*v1.Secret" May 26 19:37:08.645817 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:08.645786 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" May 26 19:37:08.645928 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:08.645900 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" May 26 19:37:08.645996 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.645910 2572 status_manager.go:895] "Failed to get status for pod" podUID="3015a41d-c574-4b8c-af71-393bda8da352" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" err="pods \"lws-controller-manager-6f8b76d9f6-hr9j5\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:37:08.674239 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.674210 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5"] May 26 19:37:08.775414 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.775379 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.775414 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.775420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzrc\" (UniqueName: \"kubernetes.io/projected/3015a41d-c574-4b8c-af71-393bda8da352-kube-api-access-8hzrc\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.775673 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.775511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-metrics-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.775673 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.775558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3015a41d-c574-4b8c-af71-393bda8da352-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.876823 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.876789 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-metrics-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.876823 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.876830 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3015a41d-c574-4b8c-af71-393bda8da352-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.877052 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.876863 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:08.877052 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:08.876969 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzrc\" (UniqueName: \"kubernetes.io/projected/3015a41d-c574-4b8c-af71-393bda8da352-kube-api-access-8hzrc\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:09.607888 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:09.607859 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hk8q8\"" May 26 19:37:09.672763 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:09.672734 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 26 19:37:09.677855 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:09.677831 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 26 19:37:09.680039 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:09.680017 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-metrics-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:09.877317 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:09.877238 2572 configmap.go:193] Couldn't get configMap openshift-lws-operator/lws-manager-config: failed to sync configmap cache: timed out waiting for the condition May 26 19:37:09.877317 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:09.877316 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3015a41d-c574-4b8c-af71-393bda8da352-manager-config podName:3015a41d-c574-4b8c-af71-393bda8da352 nodeName:}" failed. No retries permitted until 2026-05-26 19:37:10.377299002 +0000 UTC m=+691.392042477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "manager-config" (UniqueName: "kubernetes.io/configmap/3015a41d-c574-4b8c-af71-393bda8da352-manager-config") pod "lws-controller-manager-6f8b76d9f6-hr9j5" (UID: "3015a41d-c574-4b8c-af71-393bda8da352") : failed to sync configmap cache: timed out waiting for the condition May 26 19:37:09.877489 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:09.877238 2572 secret.go:189] Couldn't get secret openshift-lws-operator/webhook-server-cert: failed to sync secret cache: timed out waiting for the condition May 26 19:37:09.877489 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:37:09.877387 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-cert podName:3015a41d-c574-4b8c-af71-393bda8da352 nodeName:}" failed. No retries permitted until 2026-05-26 19:37:10.377375015 +0000 UTC m=+691.392118496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-cert") pod "lws-controller-manager-6f8b76d9f6-hr9j5" (UID: "3015a41d-c574-4b8c-af71-393bda8da352") : failed to sync secret cache: timed out waiting for the condition May 26 19:37:09.911136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:09.911106 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 26 19:37:09.920622 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:09.920592 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzrc\" (UniqueName: \"kubernetes.io/projected/3015a41d-c574-4b8c-af71-393bda8da352-kube-api-access-8hzrc\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:10.017539 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.017504 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 26 19:37:10.223984 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.223952 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 26 19:37:10.389841 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.389793 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3015a41d-c574-4b8c-af71-393bda8da352-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:10.390032 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.389880 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:10.390397 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.390377 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3015a41d-c574-4b8c-af71-393bda8da352-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:10.392213 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.392192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3015a41d-c574-4b8c-af71-393bda8da352-cert\") pod \"lws-controller-manager-6f8b76d9f6-hr9j5\" (UID: \"3015a41d-c574-4b8c-af71-393bda8da352\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:10.449582 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.449538 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:10.582198 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.582171 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5"] May 26 19:37:10.584426 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:37:10.584394 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3015a41d_c574_4b8c_af71_393bda8da352.slice/crio-02fd3d4bb94e1cae8b5eb4b0b29e39df2eac5ebac12012d38fec1e385e0e33c3 WatchSource:0}: Error finding container 02fd3d4bb94e1cae8b5eb4b0b29e39df2eac5ebac12012d38fec1e385e0e33c3: Status 404 returned error can't find the container with id 02fd3d4bb94e1cae8b5eb4b0b29e39df2eac5ebac12012d38fec1e385e0e33c3 May 26 19:37:10.628014 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:10.627987 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" event={"ID":"3015a41d-c574-4b8c-af71-393bda8da352","Type":"ContainerStarted","Data":"02fd3d4bb94e1cae8b5eb4b0b29e39df2eac5ebac12012d38fec1e385e0e33c3"} May 26 19:37:13.640272 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:13.640233 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" event={"ID":"3015a41d-c574-4b8c-af71-393bda8da352","Type":"ContainerStarted","Data":"7f639d74456dbd1343613a2be111326475088ca04f8e789c0700357ba1eb691d"} May 26 19:37:13.640716 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:13.640333 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:13.655973 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:13.655925 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" podStartSLOduration=3.4850917790000002 podStartE2EDuration="5.655909339s" podCreationTimestamp="2026-05-26 19:37:08 +0000 UTC" firstStartedPulling="2026-05-26 19:37:10.586131191 +0000 UTC m=+691.600874670" lastFinishedPulling="2026-05-26 19:37:12.756948749 +0000 UTC m=+693.771692230" observedRunningTime="2026-05-26 19:37:13.654767642 +0000 UTC m=+694.669511139" watchObservedRunningTime="2026-05-26 19:37:13.655909339 +0000 UTC m=+694.670652836" May 26 19:37:24.645979 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:24.645947 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-hr9j5" May 26 19:37:46.381928 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.381889 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl"] May 26 19:37:46.398286 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.398252 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl"] May 26 19:37:46.398440 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.398387 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.400749 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.400726 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 26 19:37:46.400921 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.400899 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bzdj8\"" May 26 19:37:46.513353 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513353 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj66f\" (UniqueName: \"kubernetes.io/projected/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-kube-api-access-pj66f\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.513944 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.513646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614225 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614187 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614235 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614255 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614276 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614302 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614332 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614358 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614401 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pj66f\" (UniqueName: \"kubernetes.io/projected/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-kube-api-access-pj66f\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614802 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614851 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614809 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614901 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.614901 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.614894 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.615152 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.615133 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.615345 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.615322 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.616602 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.616577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.616833 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.616817 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.622250 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.622219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.622344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.622265 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj66f\" (UniqueName: \"kubernetes.io/projected/3d78fbfb-42f9-4d65-a0d9-fea89d7073f5-kube-api-access-pj66f\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8c59hl\" (UID: \"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.709258 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.709228 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:46.854607 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:46.854578 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl"] May 26 19:37:46.857338 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:37:46.857297 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d78fbfb_42f9_4d65_a0d9_fea89d7073f5.slice/crio-c4c1b410f6b4fcfd44af1c1cc94259a21be7f5e837c63901b2f5e5279670bef4 WatchSource:0}: Error finding container c4c1b410f6b4fcfd44af1c1cc94259a21be7f5e837c63901b2f5e5279670bef4: Status 404 returned error can't find the container with id c4c1b410f6b4fcfd44af1c1cc94259a21be7f5e837c63901b2f5e5279670bef4 May 26 19:37:47.741722 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:47.741687 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" event={"ID":"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5","Type":"ContainerStarted","Data":"c4c1b410f6b4fcfd44af1c1cc94259a21be7f5e837c63901b2f5e5279670bef4"} May 26 19:37:49.539222 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:49.539170 2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 26 19:37:49.539495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:49.539251 2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 26 19:37:49.539495 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:49.539305 2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 26 19:37:49.752500 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:49.752466 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" event={"ID":"3d78fbfb-42f9-4d65-a0d9-fea89d7073f5","Type":"ContainerStarted","Data":"1befc689ff16c1e543bbefd1e09bf2681c7f3a73b2c8a0a3a1725759389c7f01"} May 26 19:37:49.771008 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:49.770952 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" podStartSLOduration=1.091515219 podStartE2EDuration="3.770908798s" podCreationTimestamp="2026-05-26 19:37:46 +0000 UTC" firstStartedPulling="2026-05-26 19:37:46.859531443 +0000 UTC m=+727.874274929" lastFinishedPulling="2026-05-26 19:37:49.538925033 +0000 UTC m=+730.553668508" observedRunningTime="2026-05-26 19:37:49.77002965 +0000 UTC m=+730.784773160" watchObservedRunningTime="2026-05-26 19:37:49.770908798 +0000 UTC m=+730.785652296" May 26 19:37:50.710430 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:50.710394 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:50.714987 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:50.714962 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:50.756131 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:50.756105 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:37:50.757066 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:37:50.757048 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8c59hl" May 26 19:38:10.253860 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.253818 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxtxn"] May 26 19:38:10.256345 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.256321 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:10.258855 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.258835 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 26 19:38:10.259948 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.259929 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 26 19:38:10.260041 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.259948 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9ltbn\"" May 26 19:38:10.266908 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.266882 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxtxn"] May 26 19:38:10.312148 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.312121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkcr\" (UniqueName: \"kubernetes.io/projected/14c05272-57a0-4f36-83c1-4b676e33f190-kube-api-access-czkcr\") pod \"kuadrant-operator-catalog-qxtxn\" (UID: \"14c05272-57a0-4f36-83c1-4b676e33f190\") " pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:10.413560 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.413526 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czkcr\" (UniqueName: \"kubernetes.io/projected/14c05272-57a0-4f36-83c1-4b676e33f190-kube-api-access-czkcr\") pod \"kuadrant-operator-catalog-qxtxn\" (UID: \"14c05272-57a0-4f36-83c1-4b676e33f190\") " pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:10.425326 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.425300 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkcr\" (UniqueName: \"kubernetes.io/projected/14c05272-57a0-4f36-83c1-4b676e33f190-kube-api-access-czkcr\") pod \"kuadrant-operator-catalog-qxtxn\" (UID: \"14c05272-57a0-4f36-83c1-4b676e33f190\") " pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:10.566818 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.566730 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:10.625760 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.625702 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxtxn"] May 26 19:38:10.690021 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.689963 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxtxn"] May 26 19:38:10.692174 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:38:10.692143 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c05272_57a0_4f36_83c1_4b676e33f190.slice/crio-03c0de197d91c79c63a4d1e322cd485a3773a98128897c813de0fdadd10554ca WatchSource:0}: Error finding container 03c0de197d91c79c63a4d1e322cd485a3773a98128897c813de0fdadd10554ca: Status 404 returned error can't find the container with id 03c0de197d91c79c63a4d1e322cd485a3773a98128897c813de0fdadd10554ca May 26 19:38:10.818990 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.818903 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" event={"ID":"14c05272-57a0-4f36-83c1-4b676e33f190","Type":"ContainerStarted","Data":"03c0de197d91c79c63a4d1e322cd485a3773a98128897c813de0fdadd10554ca"} May 26 19:38:10.834382 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.834345 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnsj"] May 26 19:38:10.837105 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.837083 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:10.844742 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.844716 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnsj"] May 26 19:38:10.919412 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:10.919382 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqrd\" (UniqueName: \"kubernetes.io/projected/1e203102-fe7e-44ad-899b-db89b989437b-kube-api-access-dtqrd\") pod \"kuadrant-operator-catalog-wvnsj\" (UID: \"1e203102-fe7e-44ad-899b-db89b989437b\") " pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:11.019993 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:11.019964 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqrd\" (UniqueName: \"kubernetes.io/projected/1e203102-fe7e-44ad-899b-db89b989437b-kube-api-access-dtqrd\") pod \"kuadrant-operator-catalog-wvnsj\" (UID: \"1e203102-fe7e-44ad-899b-db89b989437b\") " pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:11.028998 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:11.028963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqrd\" (UniqueName: \"kubernetes.io/projected/1e203102-fe7e-44ad-899b-db89b989437b-kube-api-access-dtqrd\") pod \"kuadrant-operator-catalog-wvnsj\" (UID: \"1e203102-fe7e-44ad-899b-db89b989437b\") " pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:11.147488 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:11.147416 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:11.276904 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:11.276744 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wvnsj"] May 26 19:38:11.302274 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:38:11.302233 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e203102_fe7e_44ad_899b_db89b989437b.slice/crio-afd45a900f7a41733a9b221bbb2de480ccfd78dc828267147c8a57f0840d357a WatchSource:0}: Error finding container afd45a900f7a41733a9b221bbb2de480ccfd78dc828267147c8a57f0840d357a: Status 404 returned error can't find the container with id afd45a900f7a41733a9b221bbb2de480ccfd78dc828267147c8a57f0840d357a May 26 19:38:11.824229 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:11.824192 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" event={"ID":"1e203102-fe7e-44ad-899b-db89b989437b","Type":"ContainerStarted","Data":"afd45a900f7a41733a9b221bbb2de480ccfd78dc828267147c8a57f0840d357a"} May 26 19:38:12.829734 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:12.829650 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" event={"ID":"1e203102-fe7e-44ad-899b-db89b989437b","Type":"ContainerStarted","Data":"10138a4f5395198ef3b0adc17608d83edccf50e659cbe068532b6196218e4efa"} May 26 19:38:12.830913 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:12.830887 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" event={"ID":"14c05272-57a0-4f36-83c1-4b676e33f190","Type":"ContainerStarted","Data":"28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6"} May 26 19:38:12.831018 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:12.830952 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" podUID="14c05272-57a0-4f36-83c1-4b676e33f190" containerName="registry-server" containerID="cri-o://28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6" gracePeriod=2 May 26 19:38:12.845727 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:12.845678 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" podStartSLOduration=1.637778654 podStartE2EDuration="2.845660673s" podCreationTimestamp="2026-05-26 19:38:10 +0000 UTC" firstStartedPulling="2026-05-26 19:38:11.303832559 +0000 UTC m=+752.318576035" lastFinishedPulling="2026-05-26 19:38:12.511714575 +0000 UTC m=+753.526458054" observedRunningTime="2026-05-26 19:38:12.84462885 +0000 UTC m=+753.859372344" watchObservedRunningTime="2026-05-26 19:38:12.845660673 +0000 UTC m=+753.860404170" May 26 19:38:12.858829 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:12.858781 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" podStartSLOduration=1.040890876 podStartE2EDuration="2.858767822s" podCreationTimestamp="2026-05-26 19:38:10 +0000 UTC" firstStartedPulling="2026-05-26 19:38:10.69349564 +0000 UTC m=+751.708239120" lastFinishedPulling="2026-05-26 19:38:12.511372588 +0000 UTC m=+753.526116066" observedRunningTime="2026-05-26 19:38:12.857223453 +0000 UTC m=+753.871966960" watchObservedRunningTime="2026-05-26 19:38:12.858767822 +0000 UTC m=+753.873511319" May 26 19:38:13.070527 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.070501 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:13.139865 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.139781 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czkcr\" (UniqueName: \"kubernetes.io/projected/14c05272-57a0-4f36-83c1-4b676e33f190-kube-api-access-czkcr\") pod \"14c05272-57a0-4f36-83c1-4b676e33f190\" (UID: \"14c05272-57a0-4f36-83c1-4b676e33f190\") " May 26 19:38:13.141941 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.141913 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c05272-57a0-4f36-83c1-4b676e33f190-kube-api-access-czkcr" (OuterVolumeSpecName: "kube-api-access-czkcr") pod "14c05272-57a0-4f36-83c1-4b676e33f190" (UID: "14c05272-57a0-4f36-83c1-4b676e33f190"). InnerVolumeSpecName "kube-api-access-czkcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:38:13.240362 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.240329 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czkcr\" (UniqueName: \"kubernetes.io/projected/14c05272-57a0-4f36-83c1-4b676e33f190-kube-api-access-czkcr\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:38:13.834479 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.834390 2572 generic.go:358] "Generic (PLEG): container finished" podID="14c05272-57a0-4f36-83c1-4b676e33f190" containerID="28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6" exitCode=0 May 26 19:38:13.834479 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.834469 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" May 26 19:38:13.834931 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.834474 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" event={"ID":"14c05272-57a0-4f36-83c1-4b676e33f190","Type":"ContainerDied","Data":"28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6"} May 26 19:38:13.834931 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.834511 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxtxn" event={"ID":"14c05272-57a0-4f36-83c1-4b676e33f190","Type":"ContainerDied","Data":"03c0de197d91c79c63a4d1e322cd485a3773a98128897c813de0fdadd10554ca"} May 26 19:38:13.834931 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.834526 2572 scope.go:117] "RemoveContainer" containerID="28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6" May 26 19:38:13.842586 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.842570 2572 scope.go:117] "RemoveContainer" containerID="28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6" May 26 19:38:13.842857 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:38:13.842839 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6\": container with ID starting with 28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6 not found: ID does not exist" containerID="28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6" May 26 19:38:13.842912 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.842864 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6"} err="failed to get container status \"28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6\": rpc error: code = NotFound desc = could not find container \"28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6\": container with ID starting with 28e1c700de7085e3d19cc6b6c677c418ca5c8352823203eeec9d35e2698d11f6 not found: ID does not exist" May 26 19:38:13.850860 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.850838 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxtxn"] May 26 19:38:13.853590 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:13.853569 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxtxn"] May 26 19:38:15.613915 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:15.613879 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c05272-57a0-4f36-83c1-4b676e33f190" path="/var/lib/kubelet/pods/14c05272-57a0-4f36-83c1-4b676e33f190/volumes" May 26 19:38:21.148143 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:21.148111 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:21.148547 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:21.148157 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:21.169462 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:21.169438 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:21.880172 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:21.880140 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wvnsj" May 26 19:38:49.307104 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.307065 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt"] May 26 19:38:49.307695 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.307519 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c05272-57a0-4f36-83c1-4b676e33f190" containerName="registry-server" May 26 19:38:49.307695 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.307540 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c05272-57a0-4f36-83c1-4b676e33f190" containerName="registry-server" May 26 19:38:49.307695 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.307650 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="14c05272-57a0-4f36-83c1-4b676e33f190" containerName="registry-server" May 26 19:38:49.311304 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.311282 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:38:49.313994 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.313974 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j8fj8\"" May 26 19:38:49.317813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.317791 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt"] May 26 19:38:49.350489 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.350452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfnhz\" (UniqueName: \"kubernetes.io/projected/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc-kube-api-access-hfnhz\") pod \"limitador-operator-controller-manager-85c4996f8c-clqnt\" (UID: \"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:38:49.451344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.451311 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfnhz\" (UniqueName: \"kubernetes.io/projected/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc-kube-api-access-hfnhz\") pod \"limitador-operator-controller-manager-85c4996f8c-clqnt\" (UID: \"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:38:49.462608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.462572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfnhz\" (UniqueName: \"kubernetes.io/projected/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc-kube-api-access-hfnhz\") pod \"limitador-operator-controller-manager-85c4996f8c-clqnt\" (UID: \"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:38:49.621676 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.621597 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:38:49.752184 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.752149 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt"] May 26 19:38:49.755424 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:38:49.755392 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea79eb52_4f3f_4ac4_9ae4_96343e9192dc.slice/crio-37328db368729482eab18d794fca1898fe6806a9cbe14122eaadfe8ff17e6ec6 WatchSource:0}: Error finding container 37328db368729482eab18d794fca1898fe6806a9cbe14122eaadfe8ff17e6ec6: Status 404 returned error can't find the container with id 37328db368729482eab18d794fca1898fe6806a9cbe14122eaadfe8ff17e6ec6 May 26 19:38:49.947799 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:49.947766 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" event={"ID":"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc","Type":"ContainerStarted","Data":"37328db368729482eab18d794fca1898fe6806a9cbe14122eaadfe8ff17e6ec6"} May 26 19:38:52.957973 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:52.957940 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" event={"ID":"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc","Type":"ContainerStarted","Data":"7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4"} May 26 19:38:52.958347 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:52.958061 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:38:52.975061 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:52.975014 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" podStartSLOduration=1.7757975190000002 podStartE2EDuration="3.975000715s" podCreationTimestamp="2026-05-26 19:38:49 +0000 UTC" firstStartedPulling="2026-05-26 19:38:49.757540587 +0000 UTC m=+790.772284064" lastFinishedPulling="2026-05-26 19:38:51.956743785 +0000 UTC m=+792.971487260" observedRunningTime="2026-05-26 19:38:52.973794472 +0000 UTC m=+793.988537970" watchObservedRunningTime="2026-05-26 19:38:52.975000715 +0000 UTC m=+793.989744212" May 26 19:38:58.120598 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.120518 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-kstbk"] May 26 19:38:58.122815 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.122797 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:38:58.125311 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.125293 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8lv7p\"" May 26 19:38:58.133304 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.133281 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-kstbk"] May 26 19:38:58.230083 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.230054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twxg7\" (UniqueName: \"kubernetes.io/projected/054c6309-10a4-4d1e-98b3-a92c7bcdcec2-kube-api-access-twxg7\") pod \"authorino-operator-657f44b778-kstbk\" (UID: \"054c6309-10a4-4d1e-98b3-a92c7bcdcec2\") " pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:38:58.331361 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.331325 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twxg7\" (UniqueName: \"kubernetes.io/projected/054c6309-10a4-4d1e-98b3-a92c7bcdcec2-kube-api-access-twxg7\") pod \"authorino-operator-657f44b778-kstbk\" (UID: \"054c6309-10a4-4d1e-98b3-a92c7bcdcec2\") " pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:38:58.339711 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.339677 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twxg7\" (UniqueName: \"kubernetes.io/projected/054c6309-10a4-4d1e-98b3-a92c7bcdcec2-kube-api-access-twxg7\") pod \"authorino-operator-657f44b778-kstbk\" (UID: \"054c6309-10a4-4d1e-98b3-a92c7bcdcec2\") " pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:38:58.433048 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.432950 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:38:58.559755 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.559729 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-kstbk"] May 26 19:38:58.561555 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:38:58.561524 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054c6309_10a4_4d1e_98b3_a92c7bcdcec2.slice/crio-ff2c8a7bebc1f941735fcf06f763c91c6ba00be5256085345617cc076ef766f9 WatchSource:0}: Error finding container ff2c8a7bebc1f941735fcf06f763c91c6ba00be5256085345617cc076ef766f9: Status 404 returned error can't find the container with id ff2c8a7bebc1f941735fcf06f763c91c6ba00be5256085345617cc076ef766f9 May 26 19:38:58.978328 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:38:58.978293 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" event={"ID":"054c6309-10a4-4d1e-98b3-a92c7bcdcec2","Type":"ContainerStarted","Data":"ff2c8a7bebc1f941735fcf06f763c91c6ba00be5256085345617cc076ef766f9"} May 26 19:39:01.989032 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:01.988995 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" event={"ID":"054c6309-10a4-4d1e-98b3-a92c7bcdcec2","Type":"ContainerStarted","Data":"2ef308f3ee8ab47012ccea99f95ec8b82d31331cf05b2aa2a85bfbc734b95db4"} May 26 19:39:01.989413 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:01.989053 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:39:02.004893 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:02.004843 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" podStartSLOduration=1.606351188 podStartE2EDuration="4.0048293s" podCreationTimestamp="2026-05-26 19:38:58 +0000 UTC" firstStartedPulling="2026-05-26 19:38:58.563437665 +0000 UTC m=+799.578181143" lastFinishedPulling="2026-05-26 19:39:00.961915759 +0000 UTC m=+801.976659255" observedRunningTime="2026-05-26 19:39:02.003767786 +0000 UTC m=+803.018511286" watchObservedRunningTime="2026-05-26 19:39:02.0048293 +0000 UTC m=+803.019572791" May 26 19:39:03.963205 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:03.963165 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:39:12.994575 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:12.994537 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-kstbk" May 26 19:39:13.966515 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:13.966481 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x"] May 26 19:39:13.968755 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:13.968734 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:13.972564 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:13.972549 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vplm6\"" May 26 19:39:13.996203 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:13.996179 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x"] May 26 19:39:14.067450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.067420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/319bf6b9-9779-4a66-82ef-384acd716467-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8759x\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:14.067605 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.067470 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxdjn\" (UniqueName: \"kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn\") pod \"kuadrant-operator-controller-manager-84b657d985-8759x\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:14.080548 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.080524 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x"] May 26 19:39:14.080777 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:39:14.080757 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-sxdjn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" podUID="319bf6b9-9779-4a66-82ef-384acd716467" May 26 19:39:14.089813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.089787 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x"] May 26 19:39:14.113371 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.113347 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt"] May 26 19:39:14.113574 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.113551 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" containerName="manager" containerID="cri-o://7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4" gracePeriod=2 May 26 19:39:14.128517 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.128492 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt"] May 26 19:39:14.139657 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.139607 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk"] May 26 19:39:14.139955 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.139943 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" containerName="manager" May 26 19:39:14.139955 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.139956 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" containerName="manager" May 26 19:39:14.140060 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.140024 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" containerName="manager" May 26 19:39:14.141998 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.141981 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:14.155686 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.155660 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk"] May 26 19:39:14.168934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.168910 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdjn\" (UniqueName: \"kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn\") pod \"kuadrant-operator-controller-manager-84b657d985-8759x\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:14.169053 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.169008 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/319bf6b9-9779-4a66-82ef-384acd716467-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8759x\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:14.169368 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.169346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/319bf6b9-9779-4a66-82ef-384acd716467-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8759x\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:14.175021 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:39:14.175003 2572 projected.go:194] Error preparing data for projected volume kube-api-access-sxdjn for pod kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-131-212.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object May 26 19:39:14.175112 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:39:14.175068 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn podName:319bf6b9-9779-4a66-82ef-384acd716467 nodeName:}" failed. No retries permitted until 2026-05-26 19:39:14.675054229 +0000 UTC m=+815.689797703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sxdjn" (UniqueName: "kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn") pod "kuadrant-operator-controller-manager-84b657d985-8759x" (UID: "319bf6b9-9779-4a66-82ef-384acd716467") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-131-212.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object May 26 19:39:14.177923 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.177892 2572 status_manager.go:895] "Failed to get status for pod" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" err="pods \"limitador-operator-controller-manager-85c4996f8c-clqnt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:14.204079 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.204055 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6"] May 26 19:39:14.206840 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.206813 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.222580 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.222534 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6"] May 26 19:39:14.237143 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.237108 2572 status_manager.go:895] "Failed to get status for pod" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" err="pods \"limitador-operator-controller-manager-85c4996f8c-clqnt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:14.270030 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.269996 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5dj9\" (UniqueName: \"kubernetes.io/projected/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-kube-api-access-x5dj9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qs8c6\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.270189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.270046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqg2l\" (UniqueName: \"kubernetes.io/projected/ff573333-95be-47d2-87f0-ef25e0021cb1-kube-api-access-nqg2l\") pod \"limitador-operator-controller-manager-85c4996f8c-vlqvk\" (UID: \"ff573333-95be-47d2-87f0-ef25e0021cb1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:14.270189 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.270168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qs8c6\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.350803 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.350780 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:39:14.353083 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.353058 2572 status_manager.go:895] "Failed to get status for pod" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" err="pods \"limitador-operator-controller-manager-85c4996f8c-clqnt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:14.370582 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.370561 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qs8c6\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.370658 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.370630 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5dj9\" (UniqueName: \"kubernetes.io/projected/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-kube-api-access-x5dj9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qs8c6\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.370709 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.370661 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqg2l\" (UniqueName: \"kubernetes.io/projected/ff573333-95be-47d2-87f0-ef25e0021cb1-kube-api-access-nqg2l\") pod \"limitador-operator-controller-manager-85c4996f8c-vlqvk\" (UID: \"ff573333-95be-47d2-87f0-ef25e0021cb1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:14.370925 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.370907 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qs8c6\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.379381 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.379358 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqg2l\" (UniqueName: \"kubernetes.io/projected/ff573333-95be-47d2-87f0-ef25e0021cb1-kube-api-access-nqg2l\") pod \"limitador-operator-controller-manager-85c4996f8c-vlqvk\" (UID: \"ff573333-95be-47d2-87f0-ef25e0021cb1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:14.379468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.379415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5dj9\" (UniqueName: \"kubernetes.io/projected/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-kube-api-access-x5dj9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qs8c6\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.471559 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.471534 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfnhz\" (UniqueName: \"kubernetes.io/projected/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc-kube-api-access-hfnhz\") pod \"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc\" (UID: \"ea79eb52-4f3f-4ac4-9ae4-96343e9192dc\") " May 26 19:39:14.473450 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.473398 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc-kube-api-access-hfnhz" (OuterVolumeSpecName: "kube-api-access-hfnhz") pod "ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" (UID: "ea79eb52-4f3f-4ac4-9ae4-96343e9192dc"). InnerVolumeSpecName "kube-api-access-hfnhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:39:14.486554 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.486529 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:14.517029 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.517002 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:14.573703 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.573302 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfnhz\" (UniqueName: \"kubernetes.io/projected/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc-kube-api-access-hfnhz\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:39:14.627326 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.627233 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk"] May 26 19:39:14.629646 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:39:14.629598 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff573333_95be_47d2_87f0_ef25e0021cb1.slice/crio-79c8c1eb60db20f1c6729b21099d9c63723d66505a8a22f02e0100f8a9f130fc WatchSource:0}: Error finding container 79c8c1eb60db20f1c6729b21099d9c63723d66505a8a22f02e0100f8a9f130fc: Status 404 returned error can't find the container with id 79c8c1eb60db20f1c6729b21099d9c63723d66505a8a22f02e0100f8a9f130fc May 26 19:39:14.659338 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.659155 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6"] May 26 19:39:14.661230 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:39:14.661208 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284e0c65_4c37_4f22_a29c_6b0bf1f0a43f.slice/crio-45c427c88ffd2f30a73035ad14fe93d6b191cbc8a372320d3748d0bfc71bc788 WatchSource:0}: Error finding container 45c427c88ffd2f30a73035ad14fe93d6b191cbc8a372320d3748d0bfc71bc788: Status 404 returned error can't find the container with id 45c427c88ffd2f30a73035ad14fe93d6b191cbc8a372320d3748d0bfc71bc788 May 26 19:39:14.775334 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:14.775248 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdjn\" (UniqueName: \"kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn\") pod \"kuadrant-operator-controller-manager-84b657d985-8759x\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:14.779814 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:39:14.779794 2572 projected.go:194] Error preparing data for projected volume kube-api-access-sxdjn for pod kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x: failed to fetch token: pod "kuadrant-operator-controller-manager-84b657d985-8759x" not found May 26 19:39:14.779913 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:39:14.779852 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn podName:319bf6b9-9779-4a66-82ef-384acd716467 nodeName:}" failed. No retries permitted until 2026-05-26 19:39:15.779838002 +0000 UTC m=+816.794581478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxdjn" (UniqueName: "kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn") pod "kuadrant-operator-controller-manager-84b657d985-8759x" (UID: "319bf6b9-9779-4a66-82ef-384acd716467") : failed to fetch token: pod "kuadrant-operator-controller-manager-84b657d985-8759x" not found May 26 19:39:15.031854 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.031775 2572 generic.go:358] "Generic (PLEG): container finished" podID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" containerID="7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4" exitCode=0 May 26 19:39:15.031854 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.031821 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" May 26 19:39:15.032303 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.031870 2572 scope.go:117] "RemoveContainer" containerID="7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4" May 26 19:39:15.033068 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.033043 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" event={"ID":"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f","Type":"ContainerStarted","Data":"45c427c88ffd2f30a73035ad14fe93d6b191cbc8a372320d3748d0bfc71bc788"} May 26 19:39:15.034209 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.034179 2572 status_manager.go:895] "Failed to get status for pod" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" err="pods \"limitador-operator-controller-manager-85c4996f8c-clqnt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:15.034542 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.034517 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" event={"ID":"ff573333-95be-47d2-87f0-ef25e0021cb1","Type":"ContainerStarted","Data":"ae406bee2845bc42318a876f601af1a56eb617860ccf49345bb91c9d01eb3a7a"} May 26 19:39:15.034542 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.034540 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:15.034718 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.034551 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" event={"ID":"ff573333-95be-47d2-87f0-ef25e0021cb1","Type":"ContainerStarted","Data":"79c8c1eb60db20f1c6729b21099d9c63723d66505a8a22f02e0100f8a9f130fc"} May 26 19:39:15.034718 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.034593 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:15.039272 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.039255 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:15.041454 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.041438 2572 scope.go:117] "RemoveContainer" containerID="7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4" May 26 19:39:15.041720 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:39:15.041702 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4\": container with ID starting with 7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4 not found: ID does not exist" containerID="7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4" May 26 19:39:15.041780 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.041727 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4"} err="failed to get container status \"7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4\": rpc error: code = NotFound desc = could not find container \"7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4\": container with ID starting with 7650b5a00a8dbecc6c96f61b421542e8e4feacb101e479f51b7c656527a306f4 not found: ID does not exist" May 26 19:39:15.057597 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.057555 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" podStartSLOduration=1.057539769 podStartE2EDuration="1.057539769s" podCreationTimestamp="2026-05-26 19:39:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:39:15.057117618 +0000 UTC m=+816.071861114" watchObservedRunningTime="2026-05-26 19:39:15.057539769 +0000 UTC m=+816.072283268" May 26 19:39:15.059898 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.059873 2572 status_manager.go:895] "Failed to get status for pod" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" err="pods \"limitador-operator-controller-manager-85c4996f8c-clqnt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:15.061728 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.061708 2572 status_manager.go:895] "Failed to get status for pod" podUID="319bf6b9-9779-4a66-82ef-384acd716467" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" err="pods \"kuadrant-operator-controller-manager-84b657d985-8759x\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:15.063725 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.063694 2572 status_manager.go:895] "Failed to get status for pod" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-clqnt" err="pods \"limitador-operator-controller-manager-85c4996f8c-clqnt\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:15.065576 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.065550 2572 status_manager.go:895] "Failed to get status for pod" podUID="319bf6b9-9779-4a66-82ef-384acd716467" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" err="pods \"kuadrant-operator-controller-manager-84b657d985-8759x\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:15.179513 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.179473 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/319bf6b9-9779-4a66-82ef-384acd716467-extensions-socket-volume\") pod \"319bf6b9-9779-4a66-82ef-384acd716467\" (UID: \"319bf6b9-9779-4a66-82ef-384acd716467\") " May 26 19:39:15.179711 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.179682 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxdjn\" (UniqueName: \"kubernetes.io/projected/319bf6b9-9779-4a66-82ef-384acd716467-kube-api-access-sxdjn\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:39:15.179780 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.179758 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319bf6b9-9779-4a66-82ef-384acd716467-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "319bf6b9-9779-4a66-82ef-384acd716467" (UID: "319bf6b9-9779-4a66-82ef-384acd716467"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:39:15.280717 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.280680 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/319bf6b9-9779-4a66-82ef-384acd716467-extensions-socket-volume\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:39:15.614921 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.614890 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="319bf6b9-9779-4a66-82ef-384acd716467" path="/var/lib/kubelet/pods/319bf6b9-9779-4a66-82ef-384acd716467/volumes" May 26 19:39:15.615172 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:15.615158 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea79eb52-4f3f-4ac4-9ae4-96343e9192dc" path="/var/lib/kubelet/pods/ea79eb52-4f3f-4ac4-9ae4-96343e9192dc/volumes" May 26 19:39:16.039472 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:16.039445 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" May 26 19:39:16.044248 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:16.044214 2572 status_manager.go:895] "Failed to get status for pod" podUID="319bf6b9-9779-4a66-82ef-384acd716467" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8759x" err="pods \"kuadrant-operator-controller-manager-84b657d985-8759x\" is forbidden: User \"system:node:ip-10-0-131-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-212.ec2.internal' and this object" May 26 19:39:19.050105 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:19.050075 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" event={"ID":"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f","Type":"ContainerStarted","Data":"b78639546b466e919aac80bd0ce3141bc425ecb3beb3a355378683bc7f5b57dd"} May 26 19:39:19.050556 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:19.050192 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:39:19.069572 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:19.069502 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" podStartSLOduration=0.89587182 podStartE2EDuration="5.069488922s" podCreationTimestamp="2026-05-26 19:39:14 +0000 UTC" firstStartedPulling="2026-05-26 19:39:14.663369965 +0000 UTC m=+815.678113444" lastFinishedPulling="2026-05-26 19:39:18.836987068 +0000 UTC m=+819.851730546" observedRunningTime="2026-05-26 19:39:19.06769706 +0000 UTC m=+820.082440556" watchObservedRunningTime="2026-05-26 19:39:19.069488922 +0000 UTC m=+820.084232421" May 26 19:39:26.041814 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:26.041779 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-vlqvk" May 26 19:39:30.055772 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:39:30.055739 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:40:39.553158 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:39.553128 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:40:39.554071 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:39.554048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:40:49.178595 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.178556 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:40:49.181943 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.181922 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 26 19:40:49.184443 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.184417 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 26 19:40:49.184443 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.184437 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 26 19:40:49.185502 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.185488 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dbbhs\"" May 26 19:40:49.185568 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.185509 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 26 19:40:49.189580 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.189557 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:40:49.285773 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.285738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq477\" (UniqueName: \"kubernetes.io/projected/2f361bd1-217f-4409-aabd-d7a8dfb642c9-kube-api-access-mq477\") pod \"maas-keycloak-0\" (UID: \"2f361bd1-217f-4409-aabd-d7a8dfb642c9\") " pod="keycloak-system/maas-keycloak-0" May 26 19:40:49.386322 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.386287 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mq477\" (UniqueName: \"kubernetes.io/projected/2f361bd1-217f-4409-aabd-d7a8dfb642c9-kube-api-access-mq477\") pod \"maas-keycloak-0\" (UID: \"2f361bd1-217f-4409-aabd-d7a8dfb642c9\") " pod="keycloak-system/maas-keycloak-0" May 26 19:40:49.394400 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.394382 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq477\" (UniqueName: \"kubernetes.io/projected/2f361bd1-217f-4409-aabd-d7a8dfb642c9-kube-api-access-mq477\") pod \"maas-keycloak-0\" (UID: \"2f361bd1-217f-4409-aabd-d7a8dfb642c9\") " pod="keycloak-system/maas-keycloak-0" May 26 19:40:49.491975 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.491920 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 26 19:40:49.620205 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:49.620175 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:40:49.623321 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:40:49.623293 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f361bd1_217f_4409_aabd_d7a8dfb642c9.slice/crio-ba2583aa41501bd223558902a8af84fa27a3dd4728a7014e8f58a69f803e45c3 WatchSource:0}: Error finding container ba2583aa41501bd223558902a8af84fa27a3dd4728a7014e8f58a69f803e45c3: Status 404 returned error can't find the container with id ba2583aa41501bd223558902a8af84fa27a3dd4728a7014e8f58a69f803e45c3 May 26 19:40:50.366493 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:50.366452 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2f361bd1-217f-4409-aabd-d7a8dfb642c9","Type":"ContainerStarted","Data":"ba2583aa41501bd223558902a8af84fa27a3dd4728a7014e8f58a69f803e45c3"} May 26 19:40:54.386769 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:54.386681 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2f361bd1-217f-4409-aabd-d7a8dfb642c9","Type":"ContainerStarted","Data":"513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16"} May 26 19:40:54.407978 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:54.407918 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.037246852 podStartE2EDuration="5.407899596s" podCreationTimestamp="2026-05-26 19:40:49 +0000 UTC" firstStartedPulling="2026-05-26 19:40:49.624551466 +0000 UTC m=+910.639294951" lastFinishedPulling="2026-05-26 19:40:53.995204221 +0000 UTC m=+915.009947695" observedRunningTime="2026-05-26 19:40:54.403842562 +0000 UTC m=+915.418586063" watchObservedRunningTime="2026-05-26 19:40:54.407899596 +0000 UTC m=+915.422643094" May 26 19:40:54.493006 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:54.492960 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 26 19:40:54.495000 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:54.494960 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:40:55.492967 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:55.492910 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:40:56.492916 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:56.492853 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:40:57.493190 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:57.493132 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:40:58.493004 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:58.492952 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:40:59.492342 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:59.492287 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 26 19:40:59.493360 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:40:59.493323 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:00.493133 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:00.493060 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:01.492895 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:01.492851 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:02.492499 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:02.492455 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:03.493500 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:03.493440 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:04.493285 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:04.493227 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:05.492597 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:05.492542 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:06.492414 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:06.492364 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" May 26 19:41:07.617279 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:07.617240 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 26 19:41:07.634657 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:07.634599 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:41:17.624751 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:17.624712 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 26 19:41:56.439258 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.439180 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69ffb86b66-hngnc"] May 26 19:41:56.442763 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.442747 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.445054 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.445031 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 26 19:41:56.452911 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.452887 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69ffb86b66-hngnc"] May 26 19:41:56.523997 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.523966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a413f5fd-403b-4a59-9178-36dd20ed4b60-maas-api-tls\") pod \"maas-api-69ffb86b66-hngnc\" (UID: \"a413f5fd-403b-4a59-9178-36dd20ed4b60\") " pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.524153 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.524029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jsdj\" (UniqueName: \"kubernetes.io/projected/a413f5fd-403b-4a59-9178-36dd20ed4b60-kube-api-access-6jsdj\") pod \"maas-api-69ffb86b66-hngnc\" (UID: \"a413f5fd-403b-4a59-9178-36dd20ed4b60\") " pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.625174 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.625138 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a413f5fd-403b-4a59-9178-36dd20ed4b60-maas-api-tls\") pod \"maas-api-69ffb86b66-hngnc\" (UID: \"a413f5fd-403b-4a59-9178-36dd20ed4b60\") " pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.625333 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.625204 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jsdj\" (UniqueName: \"kubernetes.io/projected/a413f5fd-403b-4a59-9178-36dd20ed4b60-kube-api-access-6jsdj\") pod \"maas-api-69ffb86b66-hngnc\" (UID: \"a413f5fd-403b-4a59-9178-36dd20ed4b60\") " pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.627673 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.627648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a413f5fd-403b-4a59-9178-36dd20ed4b60-maas-api-tls\") pod \"maas-api-69ffb86b66-hngnc\" (UID: \"a413f5fd-403b-4a59-9178-36dd20ed4b60\") " pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.633040 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.633014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jsdj\" (UniqueName: \"kubernetes.io/projected/a413f5fd-403b-4a59-9178-36dd20ed4b60-kube-api-access-6jsdj\") pod \"maas-api-69ffb86b66-hngnc\" (UID: \"a413f5fd-403b-4a59-9178-36dd20ed4b60\") " pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.754253 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.754139 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:56.886783 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.886755 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69ffb86b66-hngnc"] May 26 19:41:56.889315 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:41:56.889284 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda413f5fd_403b_4a59_9178_36dd20ed4b60.slice/crio-0ce1f7952c057f9aa0e247b177cbcada2efd54cd1ae2f9d49c7b626e1a6c3a43 WatchSource:0}: Error finding container 0ce1f7952c057f9aa0e247b177cbcada2efd54cd1ae2f9d49c7b626e1a6c3a43: Status 404 returned error can't find the container with id 0ce1f7952c057f9aa0e247b177cbcada2efd54cd1ae2f9d49c7b626e1a6c3a43 May 26 19:41:56.890518 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:56.890503 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:41:57.616451 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:57.616400 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69ffb86b66-hngnc" event={"ID":"a413f5fd-403b-4a59-9178-36dd20ed4b60","Type":"ContainerStarted","Data":"0ce1f7952c057f9aa0e247b177cbcada2efd54cd1ae2f9d49c7b626e1a6c3a43"} May 26 19:41:59.621579 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:59.621547 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69ffb86b66-hngnc" event={"ID":"a413f5fd-403b-4a59-9178-36dd20ed4b60","Type":"ContainerStarted","Data":"0194255f21188187b69e7104c13a6c75991aad2ed911c66da2fae73e71f13762"} May 26 19:41:59.621948 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:59.621649 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:41:59.644340 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:41:59.644290 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-69ffb86b66-hngnc" podStartSLOduration=1.4279069629999999 podStartE2EDuration="3.64427654s" podCreationTimestamp="2026-05-26 19:41:56 +0000 UTC" firstStartedPulling="2026-05-26 19:41:56.890677203 +0000 UTC m=+977.905420682" lastFinishedPulling="2026-05-26 19:41:59.107046781 +0000 UTC m=+980.121790259" observedRunningTime="2026-05-26 19:41:59.642096422 +0000 UTC m=+980.656839919" watchObservedRunningTime="2026-05-26 19:41:59.64427654 +0000 UTC m=+980.659020036" May 26 19:42:05.631269 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:05.631233 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69ffb86b66-hngnc" May 26 19:42:07.463463 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:07.463423 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:42:07.463885 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:07.463666 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" containerID="cri-o://513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16" gracePeriod=30 May 26 19:42:07.621809 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:07.621770 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:42:09.511801 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.511775 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.642162 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.642068 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq477\" (UniqueName: \"kubernetes.io/projected/2f361bd1-217f-4409-aabd-d7a8dfb642c9-kube-api-access-mq477\") pod \"2f361bd1-217f-4409-aabd-d7a8dfb642c9\" (UID: \"2f361bd1-217f-4409-aabd-d7a8dfb642c9\") " May 26 19:42:09.644384 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.644351 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f361bd1-217f-4409-aabd-d7a8dfb642c9-kube-api-access-mq477" (OuterVolumeSpecName: "kube-api-access-mq477") pod "2f361bd1-217f-4409-aabd-d7a8dfb642c9" (UID: "2f361bd1-217f-4409-aabd-d7a8dfb642c9"). InnerVolumeSpecName "kube-api-access-mq477". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:42:09.656281 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.656254 2572 generic.go:358] "Generic (PLEG): container finished" podID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerID="513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16" exitCode=143 May 26 19:42:09.656380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.656308 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.656380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.656331 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2f361bd1-217f-4409-aabd-d7a8dfb642c9","Type":"ContainerDied","Data":"513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16"} May 26 19:42:09.656380 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.656369 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2f361bd1-217f-4409-aabd-d7a8dfb642c9","Type":"ContainerDied","Data":"ba2583aa41501bd223558902a8af84fa27a3dd4728a7014e8f58a69f803e45c3"} May 26 19:42:09.656502 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.656384 2572 scope.go:117] "RemoveContainer" containerID="513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16" May 26 19:42:09.665608 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.665586 2572 scope.go:117] "RemoveContainer" containerID="513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16" May 26 19:42:09.665857 ip-10-0-131-212 kubenswrapper[2572]: E0526 19:42:09.665841 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16\": container with ID starting with 513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16 not found: ID does not exist" containerID="513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16" May 26 19:42:09.665927 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.665862 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16"} err="failed to get container status \"513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16\": rpc error: code = NotFound desc = could not find container \"513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16\": container with ID starting with 513d59f37ed645940800f598cca10b8cffe0dd779cb728dc54969266019a1e16 not found: ID does not exist" May 26 19:42:09.677035 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.677012 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:42:09.680986 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.680967 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:42:09.700921 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.700899 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:42:09.701252 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.701239 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" May 26 19:42:09.701297 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.701256 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" May 26 19:42:09.701340 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.701330 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" containerName="keycloak" May 26 19:42:09.705760 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.705745 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.708447 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.708423 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dbbhs\"" May 26 19:42:09.708584 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.708471 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 26 19:42:09.708584 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.708526 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" May 26 19:42:09.708584 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.708531 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 26 19:42:09.708752 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.708698 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 26 19:42:09.712924 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.712899 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:42:09.743127 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.743093 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq477\" (UniqueName: \"kubernetes.io/projected/2f361bd1-217f-4409-aabd-d7a8dfb642c9-kube-api-access-mq477\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:42:09.844330 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.844296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbsr\" (UniqueName: \"kubernetes.io/projected/a00520ac-6fb6-4535-b407-aed48728db0e-kube-api-access-2mbsr\") pod \"maas-keycloak-0\" (UID: \"a00520ac-6fb6-4535-b407-aed48728db0e\") " pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.844515 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.844351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a00520ac-6fb6-4535-b407-aed48728db0e-test-realms\") pod \"maas-keycloak-0\" (UID: \"a00520ac-6fb6-4535-b407-aed48728db0e\") " pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.945049 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.945018 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbsr\" (UniqueName: \"kubernetes.io/projected/a00520ac-6fb6-4535-b407-aed48728db0e-kube-api-access-2mbsr\") pod \"maas-keycloak-0\" (UID: \"a00520ac-6fb6-4535-b407-aed48728db0e\") " pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.945203 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.945077 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a00520ac-6fb6-4535-b407-aed48728db0e-test-realms\") pod \"maas-keycloak-0\" (UID: \"a00520ac-6fb6-4535-b407-aed48728db0e\") " pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.945746 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.945727 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a00520ac-6fb6-4535-b407-aed48728db0e-test-realms\") pod \"maas-keycloak-0\" (UID: \"a00520ac-6fb6-4535-b407-aed48728db0e\") " pod="keycloak-system/maas-keycloak-0" May 26 19:42:09.953389 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:09.953356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbsr\" (UniqueName: \"kubernetes.io/projected/a00520ac-6fb6-4535-b407-aed48728db0e-kube-api-access-2mbsr\") pod \"maas-keycloak-0\" (UID: \"a00520ac-6fb6-4535-b407-aed48728db0e\") " pod="keycloak-system/maas-keycloak-0" May 26 19:42:10.017208 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:10.017168 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 26 19:42:10.152267 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:10.151257 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 26 19:42:10.661794 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:10.661753 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a00520ac-6fb6-4535-b407-aed48728db0e","Type":"ContainerStarted","Data":"468695bda1f5c8f510c2bfc1556a23b0f5f59c6625059af307952a29aa6adc64"} May 26 19:42:10.661794 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:10.661790 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a00520ac-6fb6-4535-b407-aed48728db0e","Type":"ContainerStarted","Data":"a090670b606a0f86617161e42ec2a18a798651c5aac0774f451e5a8bf9885535"} May 26 19:42:10.679952 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:10.679905 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.320208829 podStartE2EDuration="1.679891553s" podCreationTimestamp="2026-05-26 19:42:09 +0000 UTC" firstStartedPulling="2026-05-26 19:42:10.156894444 +0000 UTC m=+991.171637930" lastFinishedPulling="2026-05-26 19:42:10.516577175 +0000 UTC m=+991.531320654" observedRunningTime="2026-05-26 19:42:10.678331674 +0000 UTC m=+991.693075172" watchObservedRunningTime="2026-05-26 19:42:10.679891553 +0000 UTC m=+991.694635050" May 26 19:42:11.017934 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:11.017879 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 26 19:42:11.019935 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:11.019900 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:11.614843 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:11.614805 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f361bd1-217f-4409-aabd-d7a8dfb642c9" path="/var/lib/kubelet/pods/2f361bd1-217f-4409-aabd-d7a8dfb642c9/volumes" May 26 19:42:12.018667 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:12.018599 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:13.017922 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:13.017857 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:14.017906 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:14.017846 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:15.017806 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:15.017750 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:16.018661 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:16.018590 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:17.019131 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:17.019071 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:18.018307 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:18.018253 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:19.018744 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:19.018688 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:20.017912 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:20.017858 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 26 19:42:20.018313 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:20.018281 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:21.018633 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:21.018580 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:22.018296 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:22.018252 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:23.018439 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:23.018395 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" May 26 19:42:24.148422 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:24.148365 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 26 19:42:24.179944 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:24.179868 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a00520ac-6fb6-4535-b407-aed48728db0e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 19:42:34.155784 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:34.155748 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 26 19:42:53.976195 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.976155 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf"] May 26 19:42:53.979396 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.979373 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:53.983015 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.982988 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nrlxv\"" May 26 19:42:53.983015 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.983008 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 26 19:42:53.983205 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.983080 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 26 19:42:53.983205 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.983095 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 26 19:42:53.989550 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:53.989527 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf"] May 26 19:42:54.069933 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.069899 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.069933 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.069937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hgz\" (UniqueName: \"kubernetes.io/projected/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-kube-api-access-42hgz\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.070136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.069959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.070136 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.070067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.070202 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.070134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.070202 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.070176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.170818 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.170780 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.170980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.170857 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.170980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.170913 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.170980 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.170951 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.171121 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.170980 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42hgz\" (UniqueName: \"kubernetes.io/projected/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-kube-api-access-42hgz\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.171121 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.171014 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.171255 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.171229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.171323 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.171301 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.171417 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.171397 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.173309 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.173286 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.173501 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.173484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.179226 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.179206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hgz\" (UniqueName: \"kubernetes.io/projected/01ee2a51-85b7-48ee-b6b5-fa37ece2c349-kube-api-access-42hgz\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf\" (UID: \"01ee2a51-85b7-48ee-b6b5-fa37ece2c349\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.289413 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.289331 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:42:54.418434 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.418402 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf"] May 26 19:42:54.421639 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:42:54.421592 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ee2a51_85b7_48ee_b6b5_fa37ece2c349.slice/crio-89152cfe3c899a0e28a1d2eeff307e8a45b6277dbf8b1f20d0ab46633b06b2d1 WatchSource:0}: Error finding container 89152cfe3c899a0e28a1d2eeff307e8a45b6277dbf8b1f20d0ab46633b06b2d1: Status 404 returned error can't find the container with id 89152cfe3c899a0e28a1d2eeff307e8a45b6277dbf8b1f20d0ab46633b06b2d1 May 26 19:42:54.837499 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:42:54.837456 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" event={"ID":"01ee2a51-85b7-48ee-b6b5-fa37ece2c349","Type":"ContainerStarted","Data":"89152cfe3c899a0e28a1d2eeff307e8a45b6277dbf8b1f20d0ab46633b06b2d1"} May 26 19:43:01.864690 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:01.864635 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" event={"ID":"01ee2a51-85b7-48ee-b6b5-fa37ece2c349","Type":"ContainerStarted","Data":"821960fb17981a37fb900bad4f15c7045bc3423f3b41c6d0b9f066a0cc990d26"} May 26 19:43:10.895881 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:10.895844 2572 generic.go:358] "Generic (PLEG): container finished" podID="01ee2a51-85b7-48ee-b6b5-fa37ece2c349" containerID="821960fb17981a37fb900bad4f15c7045bc3423f3b41c6d0b9f066a0cc990d26" exitCode=0 May 26 19:43:10.896385 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:10.895916 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" event={"ID":"01ee2a51-85b7-48ee-b6b5-fa37ece2c349","Type":"ContainerDied","Data":"821960fb17981a37fb900bad4f15c7045bc3423f3b41c6d0b9f066a0cc990d26"} May 26 19:43:12.904308 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:12.904272 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" event={"ID":"01ee2a51-85b7-48ee-b6b5-fa37ece2c349","Type":"ContainerStarted","Data":"a365b326225df2e30c44b3538047d85195b28b137c0805cac18eacf8b8d31628"} May 26 19:43:12.904804 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:12.904633 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:43:12.927452 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:12.922229 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" podStartSLOduration=2.2762354240000002 podStartE2EDuration="19.922214184s" podCreationTimestamp="2026-05-26 19:42:53 +0000 UTC" firstStartedPulling="2026-05-26 19:42:54.423530551 +0000 UTC m=+1035.438274029" lastFinishedPulling="2026-05-26 19:43:12.06950931 +0000 UTC m=+1053.084252789" observedRunningTime="2026-05-26 19:43:12.921081598 +0000 UTC m=+1053.935825095" watchObservedRunningTime="2026-05-26 19:43:12.922214184 +0000 UTC m=+1053.936957682" May 26 19:43:14.666400 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.666366 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45"] May 26 19:43:14.670067 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.670042 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.672526 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.672500 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 26 19:43:14.678205 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.678181 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45"] May 26 19:43:14.766699 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.766667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96g4\" (UniqueName: \"kubernetes.io/projected/0a4eb582-b9a8-47a8-bc68-241eecb68f26-kube-api-access-r96g4\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.766851 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.766716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.766851 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.766777 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.766851 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.766837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.766954 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.766869 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.766954 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.766944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4eb582-b9a8-47a8-bc68-241eecb68f26-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.867583 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.867555 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4eb582-b9a8-47a8-bc68-241eecb68f26-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.867752 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.867592 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r96g4\" (UniqueName: \"kubernetes.io/projected/0a4eb582-b9a8-47a8-bc68-241eecb68f26-kube-api-access-r96g4\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.867752 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.867644 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.867752 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.867672 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.867752 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.867710 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.867904 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.867855 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.868111 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.868090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.868204 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.868157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.868204 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.868158 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.869932 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.869909 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a4eb582-b9a8-47a8-bc68-241eecb68f26-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.870159 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.870141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a4eb582-b9a8-47a8-bc68-241eecb68f26-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.875478 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.875455 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96g4\" (UniqueName: \"kubernetes.io/projected/0a4eb582-b9a8-47a8-bc68-241eecb68f26-kube-api-access-r96g4\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45\" (UID: \"0a4eb582-b9a8-47a8-bc68-241eecb68f26\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:14.980683 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:14.980651 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:15.115004 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:15.114971 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45"] May 26 19:43:15.117909 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:43:15.117869 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4eb582_b9a8_47a8_bc68_241eecb68f26.slice/crio-6858b175b86f1fa47cf7e2a917a1b53c2ad626ff07cbaf35cc11428e1af4d27d WatchSource:0}: Error finding container 6858b175b86f1fa47cf7e2a917a1b53c2ad626ff07cbaf35cc11428e1af4d27d: Status 404 returned error can't find the container with id 6858b175b86f1fa47cf7e2a917a1b53c2ad626ff07cbaf35cc11428e1af4d27d May 26 19:43:15.916018 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:15.915983 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" event={"ID":"0a4eb582-b9a8-47a8-bc68-241eecb68f26","Type":"ContainerStarted","Data":"2a0669bee812ddf34c3771b7cc9a999498e24096b6ce23645cb82247e1156d53"} May 26 19:43:15.916018 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:15.916023 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" event={"ID":"0a4eb582-b9a8-47a8-bc68-241eecb68f26","Type":"ContainerStarted","Data":"6858b175b86f1fa47cf7e2a917a1b53c2ad626ff07cbaf35cc11428e1af4d27d"} May 26 19:43:20.936813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:20.936720 2572 generic.go:358] "Generic (PLEG): container finished" podID="0a4eb582-b9a8-47a8-bc68-241eecb68f26" containerID="2a0669bee812ddf34c3771b7cc9a999498e24096b6ce23645cb82247e1156d53" exitCode=0 May 26 19:43:20.936813 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:20.936763 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" event={"ID":"0a4eb582-b9a8-47a8-bc68-241eecb68f26","Type":"ContainerDied","Data":"2a0669bee812ddf34c3771b7cc9a999498e24096b6ce23645cb82247e1156d53"} May 26 19:43:21.941435 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:21.941398 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" event={"ID":"0a4eb582-b9a8-47a8-bc68-241eecb68f26","Type":"ContainerStarted","Data":"7e6aa5ef73c1567297efdb764e96b3490dcfaca8dc827a2fe443d82a0d4fc5aa"} May 26 19:43:21.941847 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:21.941636 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:43:21.961238 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:21.961183 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" podStartSLOduration=7.579271502 podStartE2EDuration="7.961160245s" podCreationTimestamp="2026-05-26 19:43:14 +0000 UTC" firstStartedPulling="2026-05-26 19:43:20.937409165 +0000 UTC m=+1061.952152640" lastFinishedPulling="2026-05-26 19:43:21.319297893 +0000 UTC m=+1062.334041383" observedRunningTime="2026-05-26 19:43:21.95926396 +0000 UTC m=+1062.974007470" watchObservedRunningTime="2026-05-26 19:43:21.961160245 +0000 UTC m=+1062.975903741" May 26 19:43:23.920709 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:23.920671 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf" May 26 19:43:32.957738 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:43:32.957694 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45" May 26 19:44:18.567428 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.567385 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm"] May 26 19:44:18.570325 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.570305 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.572699 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.572671 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 26 19:44:18.578230 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.578209 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm"] May 26 19:44:18.656666 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.656601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31830616-3358-4f95-a9a8-96354047a60e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.656852 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.656673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.656852 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.656746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.656852 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.656832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qntcs\" (UniqueName: \"kubernetes.io/projected/31830616-3358-4f95-a9a8-96354047a60e-kube-api-access-qntcs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.657026 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.656880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.657026 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.656980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.757947 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.757911 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758108 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.757960 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qntcs\" (UniqueName: \"kubernetes.io/projected/31830616-3358-4f95-a9a8-96354047a60e-kube-api-access-qntcs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758108 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.757992 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758108 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.758029 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758108 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.758101 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31830616-3358-4f95-a9a8-96354047a60e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758293 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.758132 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758466 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.758438 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758536 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.758485 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.758536 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.758514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.760270 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.760247 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31830616-3358-4f95-a9a8-96354047a60e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.760637 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.760603 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31830616-3358-4f95-a9a8-96354047a60e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.765657 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.765635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qntcs\" (UniqueName: \"kubernetes.io/projected/31830616-3358-4f95-a9a8-96354047a60e-kube-api-access-qntcs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm\" (UID: \"31830616-3358-4f95-a9a8-96354047a60e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:18.881316 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:18.881232 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:19.009315 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:19.009281 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm"] May 26 19:44:19.011723 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:44:19.011689 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31830616_3358_4f95_a9a8_96354047a60e.slice/crio-e831a6f552c5b3dc5533c2a8edd92b9a7dd20ccdf4a57f6c15cc68809ccf83e1 WatchSource:0}: Error finding container e831a6f552c5b3dc5533c2a8edd92b9a7dd20ccdf4a57f6c15cc68809ccf83e1: Status 404 returned error can't find the container with id e831a6f552c5b3dc5533c2a8edd92b9a7dd20ccdf4a57f6c15cc68809ccf83e1 May 26 19:44:19.143443 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:19.143349 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" event={"ID":"31830616-3358-4f95-a9a8-96354047a60e","Type":"ContainerStarted","Data":"16cf023fcb64951753bfab776acbbe21a8568e5ca693d2b99501200fb9d30f80"} May 26 19:44:19.143443 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:19.143390 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" event={"ID":"31830616-3358-4f95-a9a8-96354047a60e","Type":"ContainerStarted","Data":"e831a6f552c5b3dc5533c2a8edd92b9a7dd20ccdf4a57f6c15cc68809ccf83e1"} May 26 19:44:29.180492 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:29.180412 2572 generic.go:358] "Generic (PLEG): container finished" podID="31830616-3358-4f95-a9a8-96354047a60e" containerID="16cf023fcb64951753bfab776acbbe21a8568e5ca693d2b99501200fb9d30f80" exitCode=0 May 26 19:44:29.180867 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:29.180481 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" event={"ID":"31830616-3358-4f95-a9a8-96354047a60e","Type":"ContainerDied","Data":"16cf023fcb64951753bfab776acbbe21a8568e5ca693d2b99501200fb9d30f80"} May 26 19:44:30.185423 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:30.185385 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" event={"ID":"31830616-3358-4f95-a9a8-96354047a60e","Type":"ContainerStarted","Data":"9d1da87dbb29775c3cca882972ce8b492b6ba95077c841fdcd52edf052cadb2a"} May 26 19:44:30.185921 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:30.185635 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:44:30.203412 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:30.203369 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" podStartSLOduration=12.011102283 podStartE2EDuration="12.203355885s" podCreationTimestamp="2026-05-26 19:44:18 +0000 UTC" firstStartedPulling="2026-05-26 19:44:29.181127299 +0000 UTC m=+1130.195870774" lastFinishedPulling="2026-05-26 19:44:29.373380887 +0000 UTC m=+1130.388124376" observedRunningTime="2026-05-26 19:44:30.201834252 +0000 UTC m=+1131.216577774" watchObservedRunningTime="2026-05-26 19:44:30.203355885 +0000 UTC m=+1131.218099383" May 26 19:44:41.201913 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:44:41.201882 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm" May 26 19:45:39.579685 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:45:39.579584 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:45:39.581457 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:45:39.581436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:50:39.607692 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:50:39.607656 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:50:39.609302 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:50:39.609277 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:55:39.631870 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:55:39.631844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:55:39.636387 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:55:39.636360 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 19:56:12.266965 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:12.266931 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6"] May 26 19:56:12.267442 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:12.267151 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" podUID="284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" containerName="manager" containerID="cri-o://b78639546b466e919aac80bd0ce3141bc425ecb3beb3a355378683bc7f5b57dd" gracePeriod=10 May 26 19:56:12.608647 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:12.608599 2572 generic.go:358] "Generic (PLEG): container finished" podID="284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" containerID="b78639546b466e919aac80bd0ce3141bc425ecb3beb3a355378683bc7f5b57dd" exitCode=0 May 26 19:56:12.608647 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:12.608643 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" event={"ID":"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f","Type":"ContainerDied","Data":"b78639546b466e919aac80bd0ce3141bc425ecb3beb3a355378683bc7f5b57dd"} May 26 19:56:13.103970 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.103948 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:56:13.187302 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.187274 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5dj9\" (UniqueName: \"kubernetes.io/projected/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-kube-api-access-x5dj9\") pod \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " May 26 19:56:13.187468 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.187337 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-extensions-socket-volume\") pod \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\" (UID: \"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f\") " May 26 19:56:13.187721 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.187696 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" (UID: "284e0c65-4c37-4f22-a29c-6b0bf1f0a43f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:56:13.189344 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.189326 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-kube-api-access-x5dj9" (OuterVolumeSpecName: "kube-api-access-x5dj9") pod "284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" (UID: "284e0c65-4c37-4f22-a29c-6b0bf1f0a43f"). InnerVolumeSpecName "kube-api-access-x5dj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:56:13.288309 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.288229 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-extensions-socket-volume\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:56:13.288309 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.288260 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5dj9\" (UniqueName: \"kubernetes.io/projected/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f-kube-api-access-x5dj9\") on node \"ip-10-0-131-212.ec2.internal\" DevicePath \"\"" May 26 19:56:13.614491 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.614417 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" May 26 19:56:13.615084 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.615061 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6" event={"ID":"284e0c65-4c37-4f22-a29c-6b0bf1f0a43f","Type":"ContainerDied","Data":"45c427c88ffd2f30a73035ad14fe93d6b191cbc8a372320d3748d0bfc71bc788"} May 26 19:56:13.615168 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.615098 2572 scope.go:117] "RemoveContainer" containerID="b78639546b466e919aac80bd0ce3141bc425ecb3beb3a355378683bc7f5b57dd" May 26 19:56:13.638485 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.638463 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6"] May 26 19:56:13.641385 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:13.641366 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qs8c6"] May 26 19:56:15.614744 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:56:15.614708 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" path="/var/lib/kubelet/pods/284e0c65-4c37-4f22-a29c-6b0bf1f0a43f/volumes" May 26 19:57:18.393666 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.393577 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg"] May 26 19:57:18.394115 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.394004 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" containerName="manager" May 26 19:57:18.394115 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.394018 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" containerName="manager" May 26 19:57:18.394545 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.394507 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="284e0c65-4c37-4f22-a29c-6b0bf1f0a43f" containerName="manager" May 26 19:57:18.398862 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.398830 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.402032 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.402006 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vplm6\"" May 26 19:57:18.407550 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.407110 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg"] May 26 19:57:18.483935 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.483892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6b5f\" (UniqueName: \"kubernetes.io/projected/eaae7b60-ae49-412d-8777-6793bfdd2ce1-kube-api-access-t6b5f\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c7dqg\" (UID: \"eaae7b60-ae49-412d-8777-6793bfdd2ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.483935 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.483937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaae7b60-ae49-412d-8777-6793bfdd2ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c7dqg\" (UID: \"eaae7b60-ae49-412d-8777-6793bfdd2ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.585385 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.585348 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6b5f\" (UniqueName: \"kubernetes.io/projected/eaae7b60-ae49-412d-8777-6793bfdd2ce1-kube-api-access-t6b5f\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c7dqg\" (UID: \"eaae7b60-ae49-412d-8777-6793bfdd2ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.585385 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.585388 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaae7b60-ae49-412d-8777-6793bfdd2ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c7dqg\" (UID: \"eaae7b60-ae49-412d-8777-6793bfdd2ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.585836 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.585818 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaae7b60-ae49-412d-8777-6793bfdd2ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c7dqg\" (UID: \"eaae7b60-ae49-412d-8777-6793bfdd2ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.596363 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.596330 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6b5f\" (UniqueName: \"kubernetes.io/projected/eaae7b60-ae49-412d-8777-6793bfdd2ce1-kube-api-access-t6b5f\") pod \"kuadrant-operator-controller-manager-55c7f4c975-c7dqg\" (UID: \"eaae7b60-ae49-412d-8777-6793bfdd2ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.711922 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.711900 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:18.846726 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.846704 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg"] May 26 19:57:18.848961 ip-10-0-131-212 kubenswrapper[2572]: W0526 19:57:18.848928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaae7b60_ae49_412d_8777_6793bfdd2ce1.slice/crio-4d452ea34991a4d83e56f3bc4e3717a67bd16723a97d290d92e74fe38848d825 WatchSource:0}: Error finding container 4d452ea34991a4d83e56f3bc4e3717a67bd16723a97d290d92e74fe38848d825: Status 404 returned error can't find the container with id 4d452ea34991a4d83e56f3bc4e3717a67bd16723a97d290d92e74fe38848d825 May 26 19:57:18.851470 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:18.851454 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:57:19.840714 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:19.840671 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" event={"ID":"eaae7b60-ae49-412d-8777-6793bfdd2ce1","Type":"ContainerStarted","Data":"b47c84286e9895ed503e245f8a14cdf42d035feb9bd322107f39a106efdb95e0"} May 26 19:57:19.840714 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:19.840716 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" event={"ID":"eaae7b60-ae49-412d-8777-6793bfdd2ce1","Type":"ContainerStarted","Data":"4d452ea34991a4d83e56f3bc4e3717a67bd16723a97d290d92e74fe38848d825"} May 26 19:57:19.841107 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:19.840765 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 19:57:19.861635 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:19.861578 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" podStartSLOduration=1.861559516 podStartE2EDuration="1.861559516s" podCreationTimestamp="2026-05-26 19:57:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:57:19.860265716 +0000 UTC m=+1900.875009217" watchObservedRunningTime="2026-05-26 19:57:19.861559516 +0000 UTC m=+1900.876303014" May 26 19:57:30.846181 ip-10-0-131-212 kubenswrapper[2572]: I0526 19:57:30.846153 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-c7dqg" May 26 20:00:39.663503 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:00:39.663476 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 20:00:39.668269 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:00:39.668249 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 20:05:39.697028 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:05:39.696986 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 20:05:39.699051 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:05:39.699031 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 20:07:07.227514 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:07.227482 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69ffb86b66-hngnc_a413f5fd-403b-4a59-9178-36dd20ed4b60/maas-api/0.log" May 26 20:07:07.920671 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:07.920633 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94b8b45bb-crq98_d07c3100-d5a2-4b7e-b44a-14758492e43a/manager/0.log" May 26 20:07:09.563280 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:09.563252 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-kstbk_054c6309-10a4-4d1e-98b3-a92c7bcdcec2/manager/0.log" May 26 20:07:09.915864 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:09.915771 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wvnsj_1e203102-fe7e-44ad-899b-db89b989437b/registry-server/0.log" May 26 20:07:10.047139 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:10.047109 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-c7dqg_eaae7b60-ae49-412d-8777-6793bfdd2ce1/manager/0.log" May 26 20:07:10.280268 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:10.280238 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-vlqvk_ff573333-95be-47d2-87f0-ef25e0021cb1/manager/0.log" May 26 20:07:10.627478 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:10.627400 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8c59hl_3d78fbfb-42f9-4d65-a0d9-fea89d7073f5/istio-proxy/0.log" May 26 20:07:11.321503 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:11.321475 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79dc7dd876-xpmtj_f101134a-e37c-4bc0-9bbc-aef5294cb842/router/0.log" May 26 20:07:11.789849 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:11.789813 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm_31830616-3358-4f95-a9a8-96354047a60e/storage-initializer/0.log" May 26 20:07:11.797066 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:11.797046 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-2mkjm_31830616-3358-4f95-a9a8-96354047a60e/main/0.log" May 26 20:07:12.137247 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:12.137171 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45_0a4eb582-b9a8-47a8-bc68-241eecb68f26/storage-initializer/0.log" May 26 20:07:12.143591 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:12.143564 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fjd45_0a4eb582-b9a8-47a8-bc68-241eecb68f26/main/0.log" May 26 20:07:12.254548 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:12.254520 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf_01ee2a51-85b7-48ee-b6b5-fa37ece2c349/storage-initializer/0.log" May 26 20:07:12.260793 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:12.260752 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-sgvvf_01ee2a51-85b7-48ee-b6b5-fa37ece2c349/main/0.log" May 26 20:07:19.268665 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:19.268635 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h44l2_35659880-b528-4be0-a5c0-7c5aee8400c9/global-pull-secret-syncer/0.log" May 26 20:07:19.453544 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:19.453508 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nn8xm_e475e731-9bc9-4a81-a8ce-e834104aa6be/konnectivity-agent/0.log" May 26 20:07:19.475933 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:19.475897 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-212.ec2.internal_e67b3710d712693834df395e6efd6c96/haproxy/0.log" May 26 20:07:24.037256 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:24.037227 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-kstbk_054c6309-10a4-4d1e-98b3-a92c7bcdcec2/manager/0.log" May 26 20:07:24.114665 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:24.114633 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wvnsj_1e203102-fe7e-44ad-899b-db89b989437b/registry-server/0.log" May 26 20:07:24.171043 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:24.170974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-c7dqg_eaae7b60-ae49-412d-8777-6793bfdd2ce1/manager/0.log" May 26 20:07:24.253238 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:24.253208 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-vlqvk_ff573333-95be-47d2-87f0-ef25e0021cb1/manager/0.log" May 26 20:07:25.777262 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:25.777173 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-q8qpr_e1ed8051-6098-4124-8d0b-eefd559e2bc9/cluster-monitoring-operator/0.log" May 26 20:07:26.080846 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.080817 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkdg6_8195b26e-a37a-41d9-9619-f8dc51e69cd1/node-exporter/0.log" May 26 20:07:26.102926 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.102903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkdg6_8195b26e-a37a-41d9-9619-f8dc51e69cd1/kube-rbac-proxy/0.log" May 26 20:07:26.124962 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.124942 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkdg6_8195b26e-a37a-41d9-9619-f8dc51e69cd1/init-textfile/0.log" May 26 20:07:26.227917 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.227814 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/prometheus/0.log" May 26 20:07:26.251428 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.251401 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/config-reloader/0.log" May 26 20:07:26.270213 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.270183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/thanos-sidecar/0.log" May 26 20:07:26.289796 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.289771 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/kube-rbac-proxy-web/0.log" May 26 20:07:26.309113 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.309094 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/kube-rbac-proxy/0.log" May 26 20:07:26.336702 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.336677 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/kube-rbac-proxy-thanos/0.log" May 26 20:07:26.355054 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.355033 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c765bdf4-10ad-4533-905f-c331be72b7bf/init-config-reloader/0.log" May 26 20:07:26.430155 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.430126 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-jvl82_658fa14c-e5e3-4b48-89fc-086c227437ab/prometheus-operator-admission-webhook/0.log" May 26 20:07:26.460301 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.460274 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b7f78cf7-44k72_458fed78-e616-4a8a-bd06-132803c40897/telemeter-client/0.log" May 26 20:07:26.481030 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.480947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b7f78cf7-44k72_458fed78-e616-4a8a-bd06-132803c40897/reload/0.log" May 26 20:07:26.502935 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:26.502913 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b7f78cf7-44k72_458fed78-e616-4a8a-bd06-132803c40897/kube-rbac-proxy/0.log" May 26 20:07:28.190335 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.190302 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h"] May 26 20:07:28.192738 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.192718 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.195267 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.195243 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gpbg8\"/\"openshift-service-ca.crt\"" May 26 20:07:28.195267 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.195259 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gpbg8\"/\"default-dockercfg-bq52n\"" May 26 20:07:28.196340 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.196324 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gpbg8\"/\"kube-root-ca.crt\"" May 26 20:07:28.202460 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.202437 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h"] May 26 20:07:28.251362 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.251329 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/1.log" May 26 20:07:28.257258 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.257235 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cbfhm_905fd8df-4fe1-41dc-9ecc-33b66ea21964/console-operator/2.log" May 26 20:07:28.339319 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.339288 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-podres\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.339490 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.339370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd96l\" (UniqueName: \"kubernetes.io/projected/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-kube-api-access-cd96l\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.339490 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.339409 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-lib-modules\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.339600 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.339521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-proc\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.339671 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.339654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-sys\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440767 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440687 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-proc\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440925 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440780 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-sys\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440925 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440811 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-podres\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440925 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440817 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-proc\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440925 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440857 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd96l\" (UniqueName: \"kubernetes.io/projected/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-kube-api-access-cd96l\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440925 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440888 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-lib-modules\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.440925 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.440913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-sys\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.441179 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.441024 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-lib-modules\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.441179 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.441033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-podres\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.448959 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.448937 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd96l\" (UniqueName: \"kubernetes.io/projected/57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8-kube-api-access-cd96l\") pod \"perf-node-gather-daemonset-pph6h\" (UID: \"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.503026 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.502992 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.630774 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.630750 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h"] May 26 20:07:28.633412 ip-10-0-131-212 kubenswrapper[2572]: W0526 20:07:28.633352 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod57ea9528_7241_4be1_9f2f_8f8c3c4ad0d8.slice/crio-b9a78af58b54d8db84717442cb9ee8a98d4320fde13d9abc34953cbac2c5aa2e WatchSource:0}: Error finding container b9a78af58b54d8db84717442cb9ee8a98d4320fde13d9abc34953cbac2c5aa2e: Status 404 returned error can't find the container with id b9a78af58b54d8db84717442cb9ee8a98d4320fde13d9abc34953cbac2c5aa2e May 26 20:07:28.635318 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.635296 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 20:07:28.955003 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.954968 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" event={"ID":"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8","Type":"ContainerStarted","Data":"489e0e3cc7a6e9061412a9ec44d259c0c16c84545241e09c8cef4500d60871dd"} May 26 20:07:28.955003 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.955003 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" event={"ID":"57ea9528-7241-4be1-9f2f-8f8c3c4ad0d8","Type":"ContainerStarted","Data":"b9a78af58b54d8db84717442cb9ee8a98d4320fde13d9abc34953cbac2c5aa2e"} May 26 20:07:28.955204 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.955055 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:28.970781 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:28.970736 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" podStartSLOduration=0.97072233 podStartE2EDuration="970.72233ms" podCreationTimestamp="2026-05-26 20:07:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:07:28.969645879 +0000 UTC m=+2509.984389374" watchObservedRunningTime="2026-05-26 20:07:28.97072233 +0000 UTC m=+2509.985465831" May 26 20:07:29.246973 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:29.246942 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-ccj9k_f13d8c97-33ab-4eaf-91eb-f8ae324ac681/volume-data-source-validator/0.log" May 26 20:07:30.080875 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:30.080819 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smpfm_ce5dc346-b4ea-4319-8fc4-644e2d102418/dns/0.log" May 26 20:07:30.098141 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:30.098120 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smpfm_ce5dc346-b4ea-4319-8fc4-644e2d102418/kube-rbac-proxy/0.log" May 26 20:07:30.177572 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:30.177545 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmlqf_9981d3b7-819a-4992-8268-264375709664/dns-node-resolver/0.log" May 26 20:07:30.641189 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:30.641152 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9d8c474b-xqwjk_803b66fd-4b74-4ba0-9e9b-8525abe4d5ea/registry/1.log" May 26 20:07:30.650680 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:30.650656 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9d8c474b-xqwjk_803b66fd-4b74-4ba0-9e9b-8525abe4d5ea/registry/2.log" May 26 20:07:30.668530 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:30.668506 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7mw7d_11bc48b0-ed2b-495b-89c9-3dddad119bbb/node-ca/0.log" May 26 20:07:31.482241 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:31.482208 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8c59hl_3d78fbfb-42f9-4d65-a0d9-fea89d7073f5/istio-proxy/0.log" May 26 20:07:31.770367 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:31.770281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79dc7dd876-xpmtj_f101134a-e37c-4bc0-9bbc-aef5294cb842/router/0.log" May 26 20:07:32.257168 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:32.257134 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ckdkh_1b84a051-b9e7-400c-887f-851052532150/serve-healthcheck-canary/0.log" May 26 20:07:32.705996 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:32.705968 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7kwtj_ed05dfac-c7b4-4686-b8e6-df8042fd4bd3/insights-operator/0.log" May 26 20:07:32.708176 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:32.708155 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7kwtj_ed05dfac-c7b4-4686-b8e6-df8042fd4bd3/insights-operator/1.log" May 26 20:07:32.726059 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:32.726037 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lt74_c3b57306-5a8f-4116-bc9a-371b47ec8b5d/kube-rbac-proxy/0.log" May 26 20:07:32.743927 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:32.743906 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lt74_c3b57306-5a8f-4116-bc9a-371b47ec8b5d/exporter/0.log" May 26 20:07:32.761937 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:32.761913 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lt74_c3b57306-5a8f-4116-bc9a-371b47ec8b5d/extractor/0.log" May 26 20:07:34.803410 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:34.803383 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69ffb86b66-hngnc_a413f5fd-403b-4a59-9178-36dd20ed4b60/maas-api/0.log" May 26 20:07:34.969838 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:34.969802 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-pph6h" May 26 20:07:35.023318 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:35.023291 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94b8b45bb-crq98_d07c3100-d5a2-4b7e-b44a-14758492e43a/manager/0.log" May 26 20:07:36.295957 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:36.295917 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f8b76d9f6-hr9j5_3015a41d-c574-4b8c-af71-393bda8da352/manager/0.log" May 26 20:07:42.055339 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.055309 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/kube-multus-additional-cni-plugins/0.log" May 26 20:07:42.075572 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.075550 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/egress-router-binary-copy/0.log" May 26 20:07:42.093291 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.093259 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/cni-plugins/0.log" May 26 20:07:42.112041 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.112009 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/bond-cni-plugin/0.log" May 26 20:07:42.134990 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.134955 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/routeoverride-cni/0.log" May 26 20:07:42.187772 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.187747 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/whereabouts-cni-bincopy/0.log" May 26 20:07:42.206691 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.206665 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9c8r_d660a004-bccd-4c8a-8bf9-6b14fd8e8240/whereabouts-cni/0.log" May 26 20:07:42.554182 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.554153 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xn9l2_59054940-d2d1-464d-a08b-3586cb3d21aa/kube-multus/0.log" May 26 20:07:42.570872 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.570850 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94xc5_7577541e-b896-4245-952d-678b254cb153/network-metrics-daemon/0.log" May 26 20:07:42.587060 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:42.587041 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94xc5_7577541e-b896-4245-952d-678b254cb153/kube-rbac-proxy/0.log" May 26 20:07:43.446797 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.446759 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/ovn-controller/0.log" May 26 20:07:43.473724 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.473694 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/ovn-acl-logging/0.log" May 26 20:07:43.494416 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.494389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/kube-rbac-proxy-node/0.log" May 26 20:07:43.512229 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.512202 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/kube-rbac-proxy-ovn-metrics/0.log" May 26 20:07:43.527219 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.527196 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/northd/0.log" May 26 20:07:43.545268 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.545242 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/nbdb/0.log" May 26 20:07:43.562641 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.562583 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/sbdb/0.log" May 26 20:07:43.658904 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:43.658876 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-59ptn_484408c5-a961-4221-826c-f965be4b0c0d/ovnkube-controller/0.log" May 26 20:07:45.282490 ip-10-0-131-212 kubenswrapper[2572]: I0526 20:07:45.282467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-k9cx8_9a675dcb-fce9-42f5-96c5-5b177460b27e/network-check-target-container/0.log"