May 31 17:23:10.291223 ip-10-0-143-182 systemd[1]: Starting Kubernetes Kubelet... May 31 17:23:10.713592 ip-10-0-143-182 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 31 17:23:10.713592 ip-10-0-143-182 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 31 17:23:10.713592 ip-10-0-143-182 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 31 17:23:10.713592 ip-10-0-143-182 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 31 17:23:10.713592 ip-10-0-143-182 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 31 17:23:10.716059 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.715983 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 31 17:23:10.718602 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718587 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:10.718602 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718603 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718607 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718615 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718619 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718623 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718625 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718628 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718631 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718634 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718637 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718640 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718642 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718645 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718651 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718653 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718656 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718659 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718662 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:10.718666 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718664 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718690 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718695 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718699 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718702 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718705 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718708 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718711 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718713 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718716 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718719 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718723 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718726 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718728 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718731 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718734 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718736 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718739 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718741 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718744 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:10.719104 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718746 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718748 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718751 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718753 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718755 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718758 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718761 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718763 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718765 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718768 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718770 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718774 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718777 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718779 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718783 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718792 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718794 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718797 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718800 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718802 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:10.719594 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718805 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718808 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718810 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718813 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718815 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718818 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718820 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718823 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718825 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718827 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718830 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718833 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718835 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718838 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718840 2567 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718842 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718845 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718847 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718849 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718852 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:10.720078 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718854 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718857 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718860 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718862 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718865 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718867 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.718871 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719247 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719253 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719255 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719258 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719260 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719264 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719266 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719269 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719271 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719274 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719276 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719279 2567 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:10.720559 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719281 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719284 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719286 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719289 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719291 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719294 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719296 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719299 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719303 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719306 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719309 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719313 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719315 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719320 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719323 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719326 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719329 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719331 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719334 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:10.721051 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719337 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719340 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719342 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719345 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719347 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719350 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719352 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719357 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719360 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719362 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719365 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719367 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719371 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719373 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719375 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719378 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719380 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719383 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719385 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719388 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:10.721517 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719390 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719392 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719395 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719397 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719400 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719402 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719404 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719407 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719409 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719411 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719414 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719417 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719420 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719423 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719426 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719428 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719431 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719433 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719435 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719438 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:10.722019 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719448 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719450 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719453 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719455 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719458 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719460 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719462 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719465 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719467 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719469 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719472 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719474 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719476 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719479 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.719481 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720558 2567 flags.go:64] FLAG: --address="0.0.0.0" May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720568 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720578 2567 flags.go:64] FLAG: --anonymous-auth="true" May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720582 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720586 2567 flags.go:64] FLAG: --authentication-token-webhook="false" May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720589 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 31 17:23:10.722512 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720593 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720598 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720601 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720605 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720609 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720612 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720615 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720618 2567 flags.go:64] FLAG: --cgroup-root="" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720620 2567 flags.go:64] FLAG: --cgroups-per-qos="true" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720623 2567 flags.go:64] FLAG: --client-ca-file="" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720626 2567 flags.go:64] FLAG: --cloud-config="" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720628 2567 flags.go:64] FLAG: --cloud-provider="external" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720637 2567 flags.go:64] FLAG: --cluster-dns="[]" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720644 2567 flags.go:64] FLAG: --cluster-domain="" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720647 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720650 2567 flags.go:64] FLAG: --config-dir="" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720652 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720656 2567 flags.go:64] FLAG: --container-log-max-files="5" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720659 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720662 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720665 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720668 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720671 2567 flags.go:64] FLAG: --contention-profiling="false" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720673 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" May 31 17:23:10.723025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720676 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720679 2567 flags.go:64] FLAG: --cpu-manager-policy="none" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720682 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720690 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720692 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720695 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720698 2567 flags.go:64] FLAG: --enable-load-reader="false" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720701 2567 flags.go:64] FLAG: --enable-server="true" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720704 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720711 2567 flags.go:64] FLAG: --event-burst="100" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720714 2567 flags.go:64] FLAG: --event-qps="50" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720716 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720720 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720722 2567 flags.go:64] FLAG: --eviction-hard="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720726 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720729 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720731 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720734 2567 flags.go:64] FLAG: --eviction-soft="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720737 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720739 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720742 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720750 2567 flags.go:64] FLAG: --experimental-mounter-path="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720756 2567 flags.go:64] FLAG: --fail-cgroupv1="false" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720759 2567 flags.go:64] FLAG: --fail-swap-on="true" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720762 2567 flags.go:64] FLAG: --feature-gates="" May 31 17:23:10.723612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720765 2567 flags.go:64] FLAG: --file-check-frequency="20s" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720768 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720771 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720774 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720777 2567 flags.go:64] FLAG: --healthz-port="10248" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720780 2567 flags.go:64] FLAG: --help="false" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720783 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-182.ec2.internal" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720786 2567 flags.go:64] FLAG: --housekeeping-interval="10s" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720788 2567 flags.go:64] FLAG: --http-check-frequency="20s" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720791 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720794 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720797 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720806 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720811 2567 flags.go:64] FLAG: --image-service-endpoint="" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720814 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720817 2567 flags.go:64] FLAG: --kube-api-burst="100" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720820 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720823 2567 flags.go:64] FLAG: --kube-api-qps="50" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720826 2567 flags.go:64] FLAG: --kube-reserved="" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720829 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720832 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720835 2567 flags.go:64] FLAG: --kubelet-cgroups="" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720838 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720841 2567 flags.go:64] FLAG: --lock-file="" May 31 17:23:10.724246 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720843 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720846 2567 flags.go:64] FLAG: --log-flush-frequency="5s" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720849 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720854 2567 flags.go:64] FLAG: --log-json-split-stream="false" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720856 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720860 2567 flags.go:64] FLAG: --log-text-split-stream="false" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720863 2567 flags.go:64] FLAG: --logging-format="text" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720866 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720869 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720872 2567 flags.go:64] FLAG: --manifest-url="" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720874 2567 flags.go:64] FLAG: --manifest-url-header="" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720878 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720881 2567 flags.go:64] FLAG: --max-open-files="1000000" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720885 2567 flags.go:64] FLAG: --max-pods="110" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720888 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720891 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720893 2567 flags.go:64] FLAG: --memory-manager-policy="None" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720896 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720899 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720902 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720905 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720911 2567 flags.go:64] FLAG: --node-status-max-images="50" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720914 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720917 2567 flags.go:64] FLAG: --oom-score-adj="-999" May 31 17:23:10.724828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720932 2567 flags.go:64] FLAG: --pod-cidr="" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720935 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720941 2567 flags.go:64] FLAG: --pod-manifest-path="" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720944 2567 flags.go:64] FLAG: --pod-max-pids="-1" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720947 2567 flags.go:64] FLAG: --pods-per-core="0" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720950 2567 flags.go:64] FLAG: --port="10250" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720953 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720956 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b0dec6fb80d5bd6" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720959 2567 flags.go:64] FLAG: --qos-reserved="" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720962 2567 flags.go:64] FLAG: --read-only-port="10255" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720965 2567 flags.go:64] FLAG: --register-node="true" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720967 2567 flags.go:64] FLAG: --register-schedulable="true" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720970 2567 flags.go:64] FLAG: --register-with-taints="" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720974 2567 flags.go:64] FLAG: --registry-burst="10" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720977 2567 flags.go:64] FLAG: --registry-qps="5" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720980 2567 flags.go:64] FLAG: --reserved-cpus="" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720983 2567 flags.go:64] FLAG: --reserved-memory="" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720986 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720990 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720992 2567 flags.go:64] FLAG: --rotate-certificates="false" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720996 2567 flags.go:64] FLAG: --rotate-server-certificates="false" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.720998 2567 flags.go:64] FLAG: --runonce="false" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721001 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721004 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721007 2567 flags.go:64] FLAG: --seccomp-default="false" May 31 17:23:10.725457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721010 2567 flags.go:64] FLAG: --serialize-image-pulls="true" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721012 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721015 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721018 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721021 2567 flags.go:64] FLAG: --storage-driver-password="root" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721024 2567 flags.go:64] FLAG: --storage-driver-secure="false" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721026 2567 flags.go:64] FLAG: --storage-driver-table="stats" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721029 2567 flags.go:64] FLAG: --storage-driver-user="root" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721032 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721039 2567 flags.go:64] FLAG: --sync-frequency="1m0s" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721042 2567 flags.go:64] FLAG: --system-cgroups="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721045 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721050 2567 flags.go:64] FLAG: --system-reserved-cgroup="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721053 2567 flags.go:64] FLAG: --tls-cert-file="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721055 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721063 2567 flags.go:64] FLAG: --tls-min-version="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721066 2567 flags.go:64] FLAG: --tls-private-key-file="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721069 2567 flags.go:64] FLAG: --topology-manager-policy="none" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721071 2567 flags.go:64] FLAG: --topology-manager-policy-options="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721074 2567 flags.go:64] FLAG: --topology-manager-scope="container" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721077 2567 flags.go:64] FLAG: --v="2" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721081 2567 flags.go:64] FLAG: --version="false" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721090 2567 flags.go:64] FLAG: --vmodule="" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721094 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 31 17:23:10.726066 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.721097 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721186 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721191 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721194 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721197 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721200 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721202 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721205 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721208 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721211 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721214 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721216 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721218 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721221 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721223 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721225 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721230 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721233 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721236 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:10.726745 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721238 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721241 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721243 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721246 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721248 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721251 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721253 2567 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721256 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721258 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721261 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721263 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721266 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721270 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721273 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721276 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721279 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721281 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721283 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721286 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:10.727291 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721288 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721291 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721293 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721295 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721298 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721300 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721303 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721306 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721308 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721311 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721315 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721317 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721320 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721323 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721325 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721327 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721330 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721332 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721335 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721337 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:10.727782 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721340 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721342 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721344 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721347 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721349 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721352 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721354 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721357 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721359 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721362 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721364 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721367 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721369 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721386 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721390 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721393 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721396 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721399 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721401 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721404 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:10.728331 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721407 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721410 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721413 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721416 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721419 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721421 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721424 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721426 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.721428 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:10.728895 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.722296 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 31 17:23:10.730285 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.730266 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" May 31 17:23:10.730285 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.730283 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730329 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730334 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730337 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730340 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730343 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730347 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730349 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730352 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730355 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730359 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730363 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730366 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730369 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730372 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730374 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730377 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730379 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730382 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730384 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:10.730397 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730387 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730393 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730396 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730399 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730402 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730404 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730407 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730409 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730412 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730415 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730417 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730419 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730422 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730424 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730427 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730429 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730432 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730434 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730437 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:10.730902 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730439 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730442 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730444 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730446 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730449 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730451 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730454 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730456 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730458 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730461 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730465 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730469 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730472 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730475 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730477 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730481 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730483 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730486 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730488 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730491 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:10.731390 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730493 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730496 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730498 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730501 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730503 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730506 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730508 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730511 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730513 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730516 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730518 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730520 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730523 2567 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730525 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730527 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730530 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730532 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730534 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730537 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730540 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:10.731876 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730542 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730545 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730547 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730549 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730552 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730554 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730556 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730559 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.730564 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730653 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730658 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730662 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730665 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730668 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730671 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 31 17:23:10.732473 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730673 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730676 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730679 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730681 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730684 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730686 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730689 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730691 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730694 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730696 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730699 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730701 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730704 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730706 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730709 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730711 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730715 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730717 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730720 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730722 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 31 17:23:10.732856 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730725 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730727 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730729 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730733 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730736 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730739 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730742 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730744 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730746 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730749 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730751 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730753 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730756 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730758 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730760 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730763 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730765 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730767 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730770 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 31 17:23:10.733364 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730772 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730774 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730777 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730779 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730782 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730784 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730786 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730789 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730791 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730794 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730797 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730799 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730801 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730804 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730806 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730809 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730811 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730813 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730816 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730818 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 31 17:23:10.733834 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730821 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730823 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730825 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730828 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730830 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730833 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730835 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730838 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730840 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730843 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730845 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730847 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730850 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730852 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730854 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730857 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730859 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730861 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730864 2567 feature_gate.go:328] unrecognized feature gate: Example May 31 17:23:10.734335 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730866 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 31 17:23:10.734785 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:10.730868 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 31 17:23:10.734785 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.730873 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 31 17:23:10.734785 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.731765 2567 server.go:962] "Client rotation is on, will bootstrap in background" May 31 17:23:10.735354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.735341 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 31 17:23:10.736213 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.736202 2567 server.go:1019] "Starting client certificate rotation" May 31 17:23:10.736324 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.736305 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 31 17:23:10.736376 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.736347 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 31 17:23:10.759825 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.759804 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 31 17:23:10.761517 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.761498 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 31 17:23:10.780094 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.780078 2567 log.go:25] "Validated CRI v1 runtime API" May 31 17:23:10.785772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.785757 2567 log.go:25] "Validated CRI v1 image API" May 31 17:23:10.787033 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.787016 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 31 17:23:10.792430 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.792398 2567 fs.go:135] Filesystem UUIDs: map[30473481-1cee-431c-96b8-1831057da211:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f3a3f41a-95e4-4367-8b31-f5955ceaac04:/dev/nvme0n1p3] May 31 17:23:10.792491 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.792430 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 31 17:23:10.800118 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.800014 2567 manager.go:217] Machine: {Timestamp:2026-05-31 17:23:10.799506827 +0000 UTC m=+0.395860360 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097135 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27c55d6a3f58bcc397b70db22ec7e7 SystemUUID:ec27c55d-6a3f-58bc-c397-b70db22ec7e7 BootID:abd64e82-9c44-4aca-a1dd-a73d4d1bb7e5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:f7:f9:b5:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:f7:f9:b5:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:8e:0f:94:46:86 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 31 17:23:10.800952 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.800941 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 31 17:23:10.801027 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.801015 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 31 17:23:10.802927 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.802887 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 31 17:23:10.802967 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.802949 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 31 17:23:10.803095 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.802937 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 31 17:23:10.803146 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.803104 2567 topology_manager.go:138] "Creating topology manager with none policy" May 31 17:23:10.803146 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.803112 2567 container_manager_linux.go:306] "Creating device plugin manager" May 31 17:23:10.803146 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.803120 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 31 17:23:10.804069 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.804058 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 31 17:23:10.805256 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.805246 2567 state_mem.go:36] "Initialized new in-memory state store" May 31 17:23:10.805363 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.805355 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 31 17:23:10.807853 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.807844 2567 kubelet.go:491] "Attempting to sync node with API server" May 31 17:23:10.807891 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.807857 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 31 17:23:10.807891 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.807869 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 31 17:23:10.807891 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.807878 2567 kubelet.go:397] "Adding apiserver pod source" May 31 17:23:10.807891 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.807887 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 31 17:23:10.809114 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.809013 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 31 17:23:10.809168 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.809123 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 31 17:23:10.812339 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.812323 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" May 31 17:23:10.814021 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.814006 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 31 17:23:10.815629 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815616 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815634 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815640 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815645 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815653 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815660 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815665 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815671 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 31 17:23:10.815675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815677 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 31 17:23:10.815876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815683 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 31 17:23:10.815876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815692 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 31 17:23:10.815876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.815697 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 31 17:23:10.816688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.816678 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 31 17:23:10.816688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.816688 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 31 17:23:10.820458 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.820443 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 31 17:23:10.820525 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.820474 2567 server.go:1295] "Started kubelet" May 31 17:23:10.820908 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.820885 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 31 17:23:10.821045 ip-10-0-143-182 systemd[1]: Started Kubernetes Kubelet. May 31 17:23:10.821277 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.821228 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 31 17:23:10.821346 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.821305 2567 server_v1.go:47] "podresources" method="list" useActivePods=true May 31 17:23:10.821611 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.821578 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 31 17:23:10.821705 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.821683 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 31 17:23:10.821751 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.821721 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 31 17:23:10.822376 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.822359 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 31 17:23:10.823621 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.823592 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bpqcd" May 31 17:23:10.824060 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.824048 2567 server.go:317] "Adding debug handlers to kubelet server" May 31 17:23:10.827562 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827544 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 31 17:23:10.827633 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827546 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 31 17:23:10.827696 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827646 2567 volume_manager.go:295] "The desired_state_of_world populator starts" May 31 17:23:10.827696 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827662 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" May 31 17:23:10.827792 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827785 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 31 17:23:10.827859 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827843 2567 reconstruct.go:97] "Volume reconstruction finished" May 31 17:23:10.827912 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.827861 2567 reconciler.go:26] "Reconciler: start to sync state" May 31 17:23:10.829789 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.829760 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:10.830139 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.830114 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 31 17:23:10.830349 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830330 2567 factory.go:55] Registering systemd factory May 31 17:23:10.830422 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830394 2567 factory.go:223] Registration of the systemd container factory successfully May 31 17:23:10.830746 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830730 2567 factory.go:153] Registering CRI-O factory May 31 17:23:10.830823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830751 2567 factory.go:223] Registration of the crio container factory successfully May 31 17:23:10.830823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830801 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 31 17:23:10.830915 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830818 2567 factory.go:103] Registering Raw factory May 31 17:23:10.830915 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.830839 2567 manager.go:1196] Started watching for new ooms in manager May 31 17:23:10.831432 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.831420 2567 manager.go:319] Starting recovery of all containers May 31 17:23:10.837271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.837241 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bpqcd" May 31 17:23:10.846914 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.846899 2567 manager.go:324] Recovery completed May 31 17:23:10.850985 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.850969 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:10.851977 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.851960 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-182.ec2.internal\" not found" node="ip-10-0-143-182.ec2.internal" May 31 17:23:10.853104 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.853091 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:10.854905 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.854888 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:10.855023 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.854948 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:10.855023 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.854963 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:10.855383 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.855368 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" May 31 17:23:10.855383 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.855382 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 31 17:23:10.855517 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.855401 2567 state_mem.go:36] "Initialized new in-memory state store" May 31 17:23:10.857554 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.857539 2567 policy_none.go:49] "None policy: Start" May 31 17:23:10.857624 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.857558 2567 memory_manager.go:186] "Starting memorymanager" policy="None" May 31 17:23:10.857624 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.857571 2567 state_mem.go:35] "Initializing new in-memory state store" May 31 17:23:10.899516 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899503 2567 manager.go:341] "Starting Device Plugin manager" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.899563 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899572 2567 server.go:85] "Starting device plugin registration server" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899760 2567 eviction_manager.go:189] "Eviction manager: starting control loop" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899772 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899887 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899984 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.899993 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.900529 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 31 17:23:10.912873 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.900566 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:10.940367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.940333 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 31 17:23:10.941661 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.941645 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 31 17:23:10.941661 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.941664 2567 status_manager.go:230] "Starting to sync pod status with apiserver" May 31 17:23:10.941796 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.941678 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 31 17:23:10.941796 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.941685 2567 kubelet.go:2451] "Starting kubelet main sync loop" May 31 17:23:10.941796 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:10.941718 2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 31 17:23:10.946057 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:10.946039 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:11.000617 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.000564 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.001461 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.001445 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.001546 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.001475 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.001546 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.001486 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.001546 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.001512 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-182.ec2.internal" May 31 17:23:11.017394 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.017376 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-182.ec2.internal" May 31 17:23:11.017443 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.017396 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-182.ec2.internal\": node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.042644 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.042620 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal"] May 31 17:23:11.042745 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.042684 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.043352 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.043338 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.043428 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.043363 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.043428 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.043373 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.044416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.044399 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.044555 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.044542 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.044590 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.044571 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.045123 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.045104 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.045123 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.045126 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.045231 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.045129 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.045231 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.045150 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.045231 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.045159 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.045231 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.045135 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.046231 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.046217 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" May 31 17:23:11.046287 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.046240 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 31 17:23:11.046872 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.046856 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientMemory" May 31 17:23:11.046913 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.046890 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasNoDiskPressure" May 31 17:23:11.046913 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.046907 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeHasSufficientPID" May 31 17:23:11.065516 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.065493 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-182.ec2.internal\" not found" node="ip-10-0-143-182.ec2.internal" May 31 17:23:11.067829 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.067814 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-182.ec2.internal\" not found" node="ip-10-0-143-182.ec2.internal" May 31 17:23:11.071336 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.071321 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.128573 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.128550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c028d7c115ef356c7e0c33314e6629b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal\" (UID: \"9c028d7c115ef356c7e0c33314e6629b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.128637 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.128584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c028d7c115ef356c7e0c33314e6629b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal\" (UID: \"9c028d7c115ef356c7e0c33314e6629b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.128637 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.128629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a816a9d5fc76ee59af61dcdc53e6d2f9-config\") pod \"kube-apiserver-proxy-ip-10-0-143-182.ec2.internal\" (UID: \"a816a9d5fc76ee59af61dcdc53e6d2f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" May 31 17:23:11.172036 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.172018 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.229251 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.229228 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c028d7c115ef356c7e0c33314e6629b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal\" (UID: \"9c028d7c115ef356c7e0c33314e6629b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.229320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.229274 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c028d7c115ef356c7e0c33314e6629b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal\" (UID: \"9c028d7c115ef356c7e0c33314e6629b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.229320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.229297 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a816a9d5fc76ee59af61dcdc53e6d2f9-config\") pod \"kube-apiserver-proxy-ip-10-0-143-182.ec2.internal\" (UID: \"a816a9d5fc76ee59af61dcdc53e6d2f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" May 31 17:23:11.229320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.229306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c028d7c115ef356c7e0c33314e6629b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal\" (UID: \"9c028d7c115ef356c7e0c33314e6629b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.229413 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.229317 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c028d7c115ef356c7e0c33314e6629b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal\" (UID: \"9c028d7c115ef356c7e0c33314e6629b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.229574 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.229332 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a816a9d5fc76ee59af61dcdc53e6d2f9-config\") pod \"kube-apiserver-proxy-ip-10-0-143-182.ec2.internal\" (UID: \"a816a9d5fc76ee59af61dcdc53e6d2f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" May 31 17:23:11.273131 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.273077 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.367889 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.367868 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:11.371749 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.371734 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" May 31 17:23:11.374175 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.374160 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.474751 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.474730 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.575194 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.575143 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.675699 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.675680 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.684596 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.684579 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:11.736256 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.736238 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 31 17:23:11.736844 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.736377 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 31 17:23:11.736844 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.736388 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 31 17:23:11.736844 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.736402 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 31 17:23:11.776569 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.776543 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.828520 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.828478 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 31 17:23:11.830870 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:11.830847 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda816a9d5fc76ee59af61dcdc53e6d2f9.slice/crio-70578b414c556a7297379d202fd15d90c4a2a9894bb29711a1201fb86ff7a28b WatchSource:0}: Error finding container 70578b414c556a7297379d202fd15d90c4a2a9894bb29711a1201fb86ff7a28b: Status 404 returned error can't find the container with id 70578b414c556a7297379d202fd15d90c4a2a9894bb29711a1201fb86ff7a28b May 31 17:23:11.831112 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:11.831090 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c028d7c115ef356c7e0c33314e6629b.slice/crio-dc6356de7f37b7b5781bf95900372a144aba7021b9a0b7e5e6ad4d127f9e7e66 WatchSource:0}: Error finding container dc6356de7f37b7b5781bf95900372a144aba7021b9a0b7e5e6ad4d127f9e7e66: Status 404 returned error can't find the container with id dc6356de7f37b7b5781bf95900372a144aba7021b9a0b7e5e6ad4d127f9e7e66 May 31 17:23:11.835267 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.835252 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:23:11.839272 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.839248 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-30 17:18:10 +0000 UTC" deadline="2028-01-02 00:42:51.292670364 +0000 UTC" May 31 17:23:11.839333 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.839272 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13927h19m39.453400927s" May 31 17:23:11.873410 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.873388 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 31 17:23:11.877522 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.877509 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.945004 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.944959 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" event={"ID":"9c028d7c115ef356c7e0c33314e6629b","Type":"ContainerStarted","Data":"dc6356de7f37b7b5781bf95900372a144aba7021b9a0b7e5e6ad4d127f9e7e66"} May 31 17:23:11.945896 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.945875 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" event={"ID":"a816a9d5fc76ee59af61dcdc53e6d2f9","Type":"ContainerStarted","Data":"70578b414c556a7297379d202fd15d90c4a2a9894bb29711a1201fb86ff7a28b"} May 31 17:23:11.947334 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.947315 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b47wn" May 31 17:23:11.977756 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:11.977738 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:11.977829 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:11.977816 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b47wn" May 31 17:23:12.078009 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.077987 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:12.178442 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.178393 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-182.ec2.internal\" not found" May 31 17:23:12.213775 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.213751 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:12.228426 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.228401 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" May 31 17:23:12.249188 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.249166 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 31 17:23:12.250288 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.250269 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" May 31 17:23:12.264349 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.264321 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 31 17:23:12.552959 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.552734 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:12.809318 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.809229 2567 apiserver.go:52] "Watching apiserver" May 31 17:23:12.819252 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.819224 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 31 17:23:12.819566 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.819542 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zfqmk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal","openshift-multus/multus-additional-cni-plugins-6b6kg","openshift-network-diagnostics/network-check-target-qhthc","openshift-cluster-node-tuning-operator/tuned-9qfwd","openshift-multus/multus-d4zv2","openshift-multus/network-metrics-daemon-jxzgt","openshift-network-operator/iptables-alerter-4l6jl","openshift-ovn-kubernetes/ovnkube-node-tdhhx","kube-system/global-pull-secret-syncer-44f6j","kube-system/konnectivity-agent-82gmj","kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8"] May 31 17:23:12.820990 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.820968 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:12.821098 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.821051 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:12.823266 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.823245 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.824268 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.824247 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:12.824354 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.824333 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:12.825510 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.825490 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.827140 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.827107 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 31 17:23:12.827236 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.827205 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 31 17:23:12.827236 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.827230 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 31 17:23:12.827399 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.827274 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jkk2h\"" May 31 17:23:12.827399 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.827115 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 31 17:23:12.827964 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.827945 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.828054 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.828038 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 31 17:23:12.830308 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.830287 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d4zv2" May 31 17:23:12.830409 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.830374 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.831818 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.831801 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.834411 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.834385 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:12.834517 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.834502 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.835734 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.835716 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:12.835827 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.835794 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:12.837113 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-tuned\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837195 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqtz\" (UniqueName: \"kubernetes.io/projected/b0de72e4-9255-4123-867d-e067eb4c8cdd-kube-api-access-qsqtz\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837195 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-system-cni-dir\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.837195 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-cnibin\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.837195 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837169 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-os-release\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-k8s-cni-cncf-io\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-sys\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-lib-modules\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0de72e4-9255-4123-867d-e067eb4c8cdd-tmp\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c414b3f4-620c-4311-a25f-d5859fb2310b-host-slash\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.837404 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxx4\" (UniqueName: \"kubernetes.io/projected/d528d8dd-5562-424a-9d6c-f89b21044c54-kube-api-access-9xxx4\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-cni-multus\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-var-lib-kubelet\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-cni-binary-copy\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-host\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gscp\" (UniqueName: \"kubernetes.io/projected/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-kube-api-access-6gscp\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysctl-d\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysctl-conf\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-run\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-host\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-cnibin\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-kubelet\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.837741 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-conf-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngxdg\" (UniqueName: \"kubernetes.io/projected/4841495e-5e34-474b-bf38-40a32da540f9-kube-api-access-ngxdg\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-cni-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-multus-certs\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-serviceca\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkd7f\" (UniqueName: \"kubernetes.io/projected/c414b3f4-620c-4311-a25f-d5859fb2310b-kube-api-access-bkd7f\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-system-cni-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-socket-dir-parent\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-netns\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-cni-bin\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-modprobe-d\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.837998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysconfig\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-os-release\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-cni-binary-copy\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-daemon-config\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.838495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838088 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnrh6\" (UniqueName: \"kubernetes.io/projected/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-kube-api-access-mnrh6\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.839244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-kubernetes\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.839244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c414b3f4-620c-4311-a25f-d5859fb2310b-iptables-alerter-script\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.839244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-hostroot\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.839244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-etc-kubernetes\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.839244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.838246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-systemd\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.840047 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.840028 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 31 17:23:12.841908 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.841880 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 31 17:23:12.842041 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.842024 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c8zlj\"" May 31 17:23:12.842203 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.842186 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 31 17:23:12.842266 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.842253 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 31 17:23:12.842341 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.842197 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 31 17:23:12.842341 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.842322 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 31 17:23:12.843344 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843204 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 31 17:23:12.843344 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843277 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 31 17:23:12.843344 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843283 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 31 17:23:12.843344 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843283 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 31 17:23:12.843565 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843502 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 31 17:23:12.843600 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843569 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 31 17:23:12.843849 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.843831 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bsp66\"" May 31 17:23:12.844424 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844406 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 31 17:23:12.844424 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844406 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 31 17:23:12.844609 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844552 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 31 17:23:12.844658 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844638 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 31 17:23:12.844693 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844655 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 31 17:23:12.844746 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844727 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l5gjr\"" May 31 17:23:12.844809 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844776 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-trkdt\"" May 31 17:23:12.844892 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844879 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 31 17:23:12.845367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.844992 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 31 17:23:12.845367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.845005 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6t9nl\"" May 31 17:23:12.845367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.845026 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 31 17:23:12.845367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.845032 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gjmmh\"" May 31 17:23:12.845367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.845076 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8jn5\"" May 31 17:23:12.928720 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.928695 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 31 17:23:12.939277 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939251 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-etc-kubernetes\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939384 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939292 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-ovn\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.939384 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bc5x\" (UniqueName: \"kubernetes.io/projected/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-kube-api-access-7bc5x\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.939384 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939359 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-conf-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939384 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939376 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-daemon-config\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-etc-kubernetes\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939426 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnrh6\" (UniqueName: \"kubernetes.io/projected/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-kube-api-access-mnrh6\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939463 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-tuned\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-conf-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939529 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqtz\" (UniqueName: \"kubernetes.io/projected/b0de72e4-9255-4123-867d-e067eb4c8cdd-kube-api-access-qsqtz\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939563 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-system-cni-dir\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.939597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939588 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-k8s-cni-cncf-io\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovnkube-script-lib\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-system-cni-dir\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939644 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-lib-modules\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-k8s-cni-cncf-io\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939718 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c414b3f4-620c-4311-a25f-d5859fb2310b-host-slash\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939741 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxx4\" (UniqueName: \"kubernetes.io/projected/d528d8dd-5562-424a-9d6c-f89b21044c54-kube-api-access-9xxx4\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939758 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-cni-multus\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-lib-modules\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-log-socket\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c414b3f4-620c-4311-a25f-d5859fb2310b-host-slash\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939779 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 31 17:23:12.939882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-cni-multus\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-cni-bin\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.939984 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940010 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-var-lib-kubelet\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-systemd-units\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-node-log\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.940135 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-var-lib-kubelet\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940162 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.940235 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:13.440203172 +0000 UTC m=+3.036556691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940263 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-host\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.940393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940395 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-cnibin\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940422 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-multus-certs\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940415 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-daemon-config\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940481 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-host\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-cnibin\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-multus-certs\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/884d0a31-2b81-4a27-83db-9a93130a7da3-kubelet-config\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940553 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-cni-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940573 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-serviceca\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-slash\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-systemd\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940663 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-cni-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovn-node-metrics-cert\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-socket-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.941016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940790 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkd7f\" (UniqueName: \"kubernetes.io/projected/c414b3f4-620c-4311-a25f-d5859fb2310b-kube-api-access-bkd7f\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940832 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-modprobe-d\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-modprobe-d\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.940977 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-os-release\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-os-release\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-serviceca\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941060 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-cni-binary-copy\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941091 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-cni-netd\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b728f509-ef8b-4f1c-bb3f-29595e7c510a-agent-certs\") pod \"konnectivity-agent-82gmj\" (UID: \"b728f509-ef8b-4f1c-bb3f-29595e7c510a\") " pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/884d0a31-2b81-4a27-83db-9a93130a7da3-dbus\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941186 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c414b3f4-620c-4311-a25f-d5859fb2310b-iptables-alerter-script\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941212 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-kubelet\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-systemd\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941271 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-cnibin\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941295 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941320 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-os-release\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-device-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.941639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941414 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-sys\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941438 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0de72e4-9255-4123-867d-e067eb4c8cdd-tmp\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941460 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941491 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gscp\" (UniqueName: \"kubernetes.io/projected/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-kube-api-access-6gscp\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-cni-binary-copy\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovnkube-config\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-env-overrides\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b728f509-ef8b-4f1c-bb3f-29595e7c510a-konnectivity-ca\") pod \"konnectivity-agent-82gmj\" (UID: \"b728f509-ef8b-4f1c-bb3f-29595e7c510a\") " pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-sys-fs\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941632 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-cni-binary-copy\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941658 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-host\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941708 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysctl-d\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941735 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysctl-conf\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941760 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-run\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941787 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngxdg\" (UniqueName: \"kubernetes.io/projected/4841495e-5e34-474b-bf38-40a32da540f9-kube-api-access-ngxdg\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:12.942230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-run-netns\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-registration-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941871 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-system-cni-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941897 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-socket-dir-parent\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941942 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-netns\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941983 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-cni-bin\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.941983 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-kubelet\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942055 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-os-release\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-sys\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-kubelet\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942185 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-cnibin\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-systemd\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.942937 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.942052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-var-lib-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.943516 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c414b3f4-620c-4311-a25f-d5859fb2310b-iptables-alerter-script\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.943516 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysctl-d\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.943516 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysctl-conf\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.943516 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-run\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.943705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-multus-socket-dir-parent\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.943705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.943705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-system-cni-dir\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.943705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-run-netns\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.943705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943679 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-host-var-lib-cni-bin\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.943705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943685 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-host\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qp4\" (UniqueName: \"kubernetes.io/projected/28599111-3933-484d-b7f7-8e751e149d5d-kube-api-access-84qp4\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943759 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysconfig\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943802 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-etc-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-kubernetes\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943908 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-hostroot\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.944006 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.943914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-sysconfig\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.944322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.944015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-hostroot\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.944322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.944046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d528d8dd-5562-424a-9d6c-f89b21044c54-cni-binary-copy\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.944322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.944062 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-kubernetes\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.944322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.944095 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d528d8dd-5562-424a-9d6c-f89b21044c54-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.944579 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.944562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0de72e4-9255-4123-867d-e067eb4c8cdd-etc-tuned\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.944657 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.944636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0de72e4-9255-4123-867d-e067eb4c8cdd-tmp\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.962554 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.962527 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:12.962665 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.962556 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:12.962665 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.962573 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:12.962665 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:12.962643 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:13.462625485 +0000 UTC m=+3.058979026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:12.966949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.966901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnrh6\" (UniqueName: \"kubernetes.io/projected/ea1db81e-b014-42c3-a8b3-e680cc3bbfb9-kube-api-access-mnrh6\") pod \"multus-d4zv2\" (UID: \"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9\") " pod="openshift-multus/multus-d4zv2" May 31 17:23:12.978461 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.978434 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-30 17:18:11 +0000 UTC" deadline="2028-02-03 19:32:21.190404505 +0000 UTC" May 31 17:23:12.978461 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.978459 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14714h9m8.211948177s" May 31 17:23:12.979592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.979546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gscp\" (UniqueName: \"kubernetes.io/projected/6e837042-0ec8-42f1-b1d3-e0a8a598c6df-kube-api-access-6gscp\") pod \"node-ca-zfqmk\" (UID: \"6e837042-0ec8-42f1-b1d3-e0a8a598c6df\") " pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:12.979720 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.979695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkd7f\" (UniqueName: \"kubernetes.io/projected/c414b3f4-620c-4311-a25f-d5859fb2310b-kube-api-access-bkd7f\") pod \"iptables-alerter-4l6jl\" (UID: \"c414b3f4-620c-4311-a25f-d5859fb2310b\") " pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:12.981072 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.981053 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqtz\" (UniqueName: \"kubernetes.io/projected/b0de72e4-9255-4123-867d-e067eb4c8cdd-kube-api-access-qsqtz\") pod \"tuned-9qfwd\" (UID: \"b0de72e4-9255-4123-867d-e067eb4c8cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:12.982079 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.982060 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxx4\" (UniqueName: \"kubernetes.io/projected/d528d8dd-5562-424a-9d6c-f89b21044c54-kube-api-access-9xxx4\") pod \"multus-additional-cni-plugins-6b6kg\" (UID: \"d528d8dd-5562-424a-9d6c-f89b21044c54\") " pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:12.982326 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:12.982309 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngxdg\" (UniqueName: \"kubernetes.io/projected/4841495e-5e34-474b-bf38-40a32da540f9-kube-api-access-ngxdg\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:13.044597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044566 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044730 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044607 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/884d0a31-2b81-4a27-83db-9a93130a7da3-kubelet-config\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.044730 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044666 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044730 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/884d0a31-2b81-4a27-83db-9a93130a7da3-kubelet-config\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.044730 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044719 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-slash\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044746 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-systemd\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044762 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-slash\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044783 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovn-node-metrics-cert\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-systemd\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044801 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044850 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-socket-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044880 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-cni-netd\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044907 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b728f509-ef8b-4f1c-bb3f-29595e7c510a-agent-certs\") pod \"konnectivity-agent-82gmj\" (UID: \"b728f509-ef8b-4f1c-bb3f-29595e7c510a\") " pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-cni-netd\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044949 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/884d0a31-2b81-4a27-83db-9a93130a7da3-dbus\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.044963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-socket-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.044989 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-device-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-device-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045041 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/884d0a31-2b81-4a27-83db-9a93130a7da3-dbus\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045081 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovnkube-config\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045109 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-env-overrides\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.045115 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045135 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b728f509-ef8b-4f1c-bb3f-29595e7c510a-konnectivity-ca\") pod \"konnectivity-agent-82gmj\" (UID: \"b728f509-ef8b-4f1c-bb3f-29595e7c510a\") " pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.045167 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:13.545147462 +0000 UTC m=+3.141500995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045420 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-sys-fs\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045454 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045486 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-run-netns\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045511 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-registration-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045539 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-kubelet\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045562 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-var-lib-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045588 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84qp4\" (UniqueName: \"kubernetes.io/projected/28599111-3933-484d-b7f7-8e751e149d5d-kube-api-access-84qp4\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.045560 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045618 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-etc-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045646 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-ovn\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-env-overrides\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045670 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bc5x\" (UniqueName: \"kubernetes.io/projected/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-kube-api-access-7bc5x\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045703 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovnkube-script-lib\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045733 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-log-socket\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-sys-fs\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045760 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045786 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-cni-bin\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-run-netns\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovnkube-config\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-var-lib-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045825 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-systemd-units\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045894 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28599111-3933-484d-b7f7-8e751e149d5d-registration-dir\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b728f509-ef8b-4f1c-bb3f-29595e7c510a-konnectivity-ca\") pod \"konnectivity-agent-82gmj\" (UID: \"b728f509-ef8b-4f1c-bb3f-29595e7c510a\") " pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045943 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-node-log\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.046535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-systemd-units\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-run-ovn\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.046033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-node-log\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.045705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-kubelet\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.046043 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-etc-openvswitch\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.046087 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-log-socket\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.046089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.046093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-host-cni-bin\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.046373 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovnkube-script-lib\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.047086 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-ovn-node-metrics-cert\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.047767 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.047745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b728f509-ef8b-4f1c-bb3f-29595e7c510a-agent-certs\") pod \"konnectivity-agent-82gmj\" (UID: \"b728f509-ef8b-4f1c-bb3f-29595e7c510a\") " pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:13.074595 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.074538 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bc5x\" (UniqueName: \"kubernetes.io/projected/4f9e72db-3b0d-454c-a87c-a687dde7c6ff-kube-api-access-7bc5x\") pod \"ovnkube-node-tdhhx\" (UID: \"4f9e72db-3b0d-454c-a87c-a687dde7c6ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.087898 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.087870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qp4\" (UniqueName: \"kubernetes.io/projected/28599111-3933-484d-b7f7-8e751e149d5d-kube-api-access-84qp4\") pod \"aws-ebs-csi-driver-node-8pln8\" (UID: \"28599111-3933-484d-b7f7-8e751e149d5d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.136132 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.136106 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" May 31 17:23:13.142960 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.142941 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" May 31 17:23:13.151479 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.151454 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfqmk" May 31 17:23:13.156736 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.156718 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d4zv2" May 31 17:23:13.164247 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.164228 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4l6jl" May 31 17:23:13.171839 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.171816 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:13.179476 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.179433 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:13.185112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.185088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" May 31 17:23:13.264722 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.264700 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:13.397597 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:13.397568 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1db81e_b014_42c3_a8b3_e680cc3bbfb9.slice/crio-3d087e27ab3bdef2a70772c019b0e75b43686e5fe439f562321fea23dcce58d7 WatchSource:0}: Error finding container 3d087e27ab3bdef2a70772c019b0e75b43686e5fe439f562321fea23dcce58d7: Status 404 returned error can't find the container with id 3d087e27ab3bdef2a70772c019b0e75b43686e5fe439f562321fea23dcce58d7 May 31 17:23:13.398908 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:13.398872 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9e72db_3b0d_454c_a87c_a687dde7c6ff.slice/crio-25a5dea225b1fd7fdc1feb479e48231c7435e445691ee798e7d4e32d24aae6d3 WatchSource:0}: Error finding container 25a5dea225b1fd7fdc1feb479e48231c7435e445691ee798e7d4e32d24aae6d3: Status 404 returned error can't find the container with id 25a5dea225b1fd7fdc1feb479e48231c7435e445691ee798e7d4e32d24aae6d3 May 31 17:23:13.399707 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:13.399684 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28599111_3933_484d_b7f7_8e751e149d5d.slice/crio-c437b523564f62484a39aeb2cb45a7c1079c9b9063a1277be29d97a966ff3491 WatchSource:0}: Error finding container c437b523564f62484a39aeb2cb45a7c1079c9b9063a1277be29d97a966ff3491: Status 404 returned error can't find the container with id c437b523564f62484a39aeb2cb45a7c1079c9b9063a1277be29d97a966ff3491 May 31 17:23:13.401677 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:13.401657 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd528d8dd_5562_424a_9d6c_f89b21044c54.slice/crio-06116ed21ea22a7feb53c8bc480d6197db84d027b55cf22d5be89657faf355db WatchSource:0}: Error finding container 06116ed21ea22a7feb53c8bc480d6197db84d027b55cf22d5be89657faf355db: Status 404 returned error can't find the container with id 06116ed21ea22a7feb53c8bc480d6197db84d027b55cf22d5be89657faf355db May 31 17:23:13.403730 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:13.403706 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0de72e4_9255_4123_867d_e067eb4c8cdd.slice/crio-7e06d205fe9773625051e6dddc5366b72cb67bf1d693f6a8ecd86f5fd35e84b0 WatchSource:0}: Error finding container 7e06d205fe9773625051e6dddc5366b72cb67bf1d693f6a8ecd86f5fd35e84b0: Status 404 returned error can't find the container with id 7e06d205fe9773625051e6dddc5366b72cb67bf1d693f6a8ecd86f5fd35e84b0 May 31 17:23:13.405444 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:13.405402 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc414b3f4_620c_4311_a25f_d5859fb2310b.slice/crio-b3bce21276e9945d11290228d518fc3c8282ced8477b642ffcfcb4f966662f63 WatchSource:0}: Error finding container b3bce21276e9945d11290228d518fc3c8282ced8477b642ffcfcb4f966662f63: Status 404 returned error can't find the container with id b3bce21276e9945d11290228d518fc3c8282ced8477b642ffcfcb4f966662f63 May 31 17:23:13.449498 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.449474 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:13.449626 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.449608 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:13.449677 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.449663 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:14.449649199 +0000 UTC m=+4.046002718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:13.550012 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.549984 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:13.550151 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.550025 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.550151 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.550121 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:13.550151 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.550145 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:13.550274 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.550168 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:13.550274 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.550182 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:13.550274 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.550185 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:14.550166704 +0000 UTC m=+4.146520224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:13.550274 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.550249 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:14.550233136 +0000 UTC m=+4.146586673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:13.941961 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.941860 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:13.942464 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.942009 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:13.942464 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.942132 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:13.942464 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:13.942222 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:13.962427 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.962394 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" event={"ID":"28599111-3933-484d-b7f7-8e751e149d5d","Type":"ContainerStarted","Data":"c437b523564f62484a39aeb2cb45a7c1079c9b9063a1277be29d97a966ff3491"} May 31 17:23:13.972208 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.972173 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d4zv2" event={"ID":"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9","Type":"ContainerStarted","Data":"3d087e27ab3bdef2a70772c019b0e75b43686e5fe439f562321fea23dcce58d7"} May 31 17:23:13.974618 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.974592 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" event={"ID":"b0de72e4-9255-4123-867d-e067eb4c8cdd","Type":"ContainerStarted","Data":"7e06d205fe9773625051e6dddc5366b72cb67bf1d693f6a8ecd86f5fd35e84b0"} May 31 17:23:13.979214 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.979184 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-30 17:18:11 +0000 UTC" deadline="2028-02-27 14:58:05.11973249 +0000 UTC" May 31 17:23:13.979326 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.979215 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15285h34m51.140520338s" May 31 17:23:13.985333 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.985307 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"25a5dea225b1fd7fdc1feb479e48231c7435e445691ee798e7d4e32d24aae6d3"} May 31 17:23:13.996704 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.995971 2567 generic.go:358] "Generic (PLEG): container finished" podID="9c028d7c115ef356c7e0c33314e6629b" containerID="f6f8ee47628838c6722d67d796b4b20ea4654542b542457e306217209bedc56e" exitCode=0 May 31 17:23:13.996704 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:13.996038 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" event={"ID":"9c028d7c115ef356c7e0c33314e6629b","Type":"ContainerDied","Data":"f6f8ee47628838c6722d67d796b4b20ea4654542b542457e306217209bedc56e"} May 31 17:23:14.007145 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.007119 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" event={"ID":"a816a9d5fc76ee59af61dcdc53e6d2f9","Type":"ContainerStarted","Data":"502ec87fce5330dc87dcf888749291eebe8c85d7e43490bd7a55df8b5c5a364c"} May 31 17:23:14.019248 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.019199 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82gmj" event={"ID":"b728f509-ef8b-4f1c-bb3f-29595e7c510a","Type":"ContainerStarted","Data":"4b2557cc3094ac77fbbd5e088696ab7859c36a93b3870655558f9db30aa654cb"} May 31 17:23:14.030907 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.030857 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfqmk" event={"ID":"6e837042-0ec8-42f1-b1d3-e0a8a598c6df","Type":"ContainerStarted","Data":"886adfa1d4f17e4a3b83085b39d82f1900658dca10fe8ae48d7fc7e612a583ed"} May 31 17:23:14.056525 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.056497 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4l6jl" event={"ID":"c414b3f4-620c-4311-a25f-d5859fb2310b","Type":"ContainerStarted","Data":"b3bce21276e9945d11290228d518fc3c8282ced8477b642ffcfcb4f966662f63"} May 31 17:23:14.063597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.063566 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerStarted","Data":"06116ed21ea22a7feb53c8bc480d6197db84d027b55cf22d5be89657faf355db"} May 31 17:23:14.457567 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.456957 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:14.457567 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.457108 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:14.457567 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.457169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:16.457149446 +0000 UTC m=+6.053502985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.558189 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.558287 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.558408 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.558462 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:16.558444712 +0000 UTC m=+6.154798248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.558659 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.558680 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.558693 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:14.559124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.558739 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:16.558718857 +0000 UTC m=+6.155072390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:14.832208 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.831887 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 31 17:23:14.944988 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:14.944458 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:14.944988 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:14.944579 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:15.093190 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:15.093107 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" event={"ID":"9c028d7c115ef356c7e0c33314e6629b","Type":"ContainerStarted","Data":"c86bbe125b9f181a2cc8afef760314903afa657b5a8947483b46de69e0f9542a"} May 31 17:23:15.116818 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:15.116768 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-182.ec2.internal" podStartSLOduration=3.11674936 podStartE2EDuration="3.11674936s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:23:14.032661936 +0000 UTC m=+3.629015478" watchObservedRunningTime="2026-05-31 17:23:15.11674936 +0000 UTC m=+4.713102902" May 31 17:23:15.942472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:15.942438 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:15.942651 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:15.942581 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:15.943044 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:15.943023 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:15.943152 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:15.943132 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:16.475980 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:16.475428 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:16.475980 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.475573 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:16.475980 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.475631 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:20.475613564 +0000 UTC m=+10.071967099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:16.576625 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:16.576579 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:16.576811 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:16.576649 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:16.576811 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.576777 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:16.576953 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.576842 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:20.576815311 +0000 UTC m=+10.173168844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:16.577303 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.577278 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:16.577303 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.577305 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:16.577474 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.577317 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:16.577474 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.577360 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:20.577346659 +0000 UTC m=+10.173700195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:16.941902 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:16.941871 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:16.942077 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:16.942011 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:17.942651 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:17.942619 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:17.943037 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:17.942758 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:17.943115 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:17.943035 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:17.943171 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:17.943148 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:18.942164 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:18.942133 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:18.942352 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:18.942269 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:19.942330 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:19.942298 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:19.942772 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:19.942429 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:19.942772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:19.942506 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:19.942772 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:19.942585 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:20.513510 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:20.513474 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:20.513693 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.513652 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:20.513762 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.513728 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:28.513706872 +0000 UTC m=+18.110060397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:20.614530 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:20.614496 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:20.614688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:20.614584 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:20.614736 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.614716 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:20.614777 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.614743 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:20.614777 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.614747 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:20.614777 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.614756 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:20.614910 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.614813 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:28.614793913 +0000 UTC m=+18.211147440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:20.614910 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.614828 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:28.614821855 +0000 UTC m=+18.211175374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:20.943519 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:20.942977 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:20.943519 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:20.943098 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:21.942729 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:21.942697 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:21.942729 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:21.942725 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:21.942959 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:21.942808 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:21.942959 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:21.942901 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:22.392372 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.392323 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-182.ec2.internal" podStartSLOduration=10.392287997 podStartE2EDuration="10.392287997s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:23:15.118819862 +0000 UTC m=+4.715173407" watchObservedRunningTime="2026-05-31 17:23:22.392287997 +0000 UTC m=+11.988641544" May 31 17:23:22.393175 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.393154 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-n56bh"] May 31 17:23:22.399217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.399193 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.405002 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.404781 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 31 17:23:22.405002 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.404808 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 31 17:23:22.405002 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.404889 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g4cnh\"" May 31 17:23:22.528021 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.527988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5r2h\" (UniqueName: \"kubernetes.io/projected/2bbcf623-ebaf-4b6c-90ca-61040294570b-kube-api-access-x5r2h\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.528173 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.528039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bbcf623-ebaf-4b6c-90ca-61040294570b-hosts-file\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.528173 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.528145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bbcf623-ebaf-4b6c-90ca-61040294570b-tmp-dir\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.628470 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.628438 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5r2h\" (UniqueName: \"kubernetes.io/projected/2bbcf623-ebaf-4b6c-90ca-61040294570b-kube-api-access-x5r2h\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.628620 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.628487 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bbcf623-ebaf-4b6c-90ca-61040294570b-hosts-file\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.628620 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.628551 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bbcf623-ebaf-4b6c-90ca-61040294570b-tmp-dir\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.628707 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.628627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bbcf623-ebaf-4b6c-90ca-61040294570b-hosts-file\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.628882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.628852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bbcf623-ebaf-4b6c-90ca-61040294570b-tmp-dir\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.641277 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.641256 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5r2h\" (UniqueName: \"kubernetes.io/projected/2bbcf623-ebaf-4b6c-90ca-61040294570b-kube-api-access-x5r2h\") pod \"node-resolver-n56bh\" (UID: \"2bbcf623-ebaf-4b6c-90ca-61040294570b\") " pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.710014 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.709947 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n56bh" May 31 17:23:22.942858 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:22.942824 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:22.943045 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:22.942967 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:23.942966 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:23.942870 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:23.942966 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:23.942884 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:23.943459 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:23.943034 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:23.943524 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:23.943486 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:24.942301 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:24.942268 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:24.942482 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:24.942397 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:25.942408 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:25.942374 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:25.942794 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:25.942376 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:25.942794 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:25.942520 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:25.942794 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:25.942578 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:26.942397 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:26.942364 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:26.942572 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:26.942470 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:27.941906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:27.941862 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:27.942088 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:27.941862 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:27.942144 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:27.942092 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:27.942231 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:27.942211 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:28.579446 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:28.579410 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:28.579829 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.579547 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:28.579829 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.579604 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:44.579584095 +0000 UTC m=+34.175937622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:28.680723 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:28.680686 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:28.680892 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:28.680753 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:28.681180 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.681157 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:28.681270 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.681213 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:28.681270 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.681238 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:28.681270 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.681262 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:28.681402 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.681394 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:44.681357668 +0000 UTC m=+34.277711199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:28.681465 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.681419 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:23:44.681407819 +0000 UTC m=+34.277761345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:28.942711 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:28.942475 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:28.942872 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:28.942774 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:29.942269 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:29.942235 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:29.942719 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:29.942304 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:29.942719 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:29.942422 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:29.942719 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:29.942498 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:30.943225 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:30.943195 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:30.943546 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:30.943271 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:31.525793 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:23:31.525769 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbcf623_ebaf_4b6c_90ca_61040294570b.slice/crio-e4de3ef211c84353fe454d47dc823b8fd66b28983810225e61da567a05585c28 WatchSource:0}: Error finding container e4de3ef211c84353fe454d47dc823b8fd66b28983810225e61da567a05585c28: Status 404 returned error can't find the container with id e4de3ef211c84353fe454d47dc823b8fd66b28983810225e61da567a05585c28 May 31 17:23:31.941938 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:31.941793 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:31.942032 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:31.941857 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:31.942032 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:31.942010 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:31.942158 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:31.942099 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:32.123719 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.123693 2567 generic.go:358] "Generic (PLEG): container finished" podID="d528d8dd-5562-424a-9d6c-f89b21044c54" containerID="642e24f18931a65c6991850526f427fe091677dc0fee25c372988b364893104e" exitCode=0 May 31 17:23:32.124351 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.123755 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerDied","Data":"642e24f18931a65c6991850526f427fe091677dc0fee25c372988b364893104e"} May 31 17:23:32.125315 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.125253 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" event={"ID":"28599111-3933-484d-b7f7-8e751e149d5d","Type":"ContainerStarted","Data":"cc5c51d5d9f1d1ab003c228f0eecdd47c0248cc57b56a8f49a908118b8d73771"} May 31 17:23:32.126586 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.126556 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d4zv2" event={"ID":"ea1db81e-b014-42c3-a8b3-e680cc3bbfb9","Type":"ContainerStarted","Data":"88614b1b7237f9e4bbe6ab5b81799fa91bf72a8f47a2e8d02f8846fda975d364"} May 31 17:23:32.128011 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.127915 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" event={"ID":"b0de72e4-9255-4123-867d-e067eb4c8cdd","Type":"ContainerStarted","Data":"b4b908b1353c3f6ede3f65583af5ec8a77b69f17490e12180d508f583ac02a9c"} May 31 17:23:32.129767 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.129749 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:23:32.130288 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.130265 2567 generic.go:358] "Generic (PLEG): container finished" podID="4f9e72db-3b0d-454c-a87c-a687dde7c6ff" containerID="ecb4d0d2f4c2889fb62f549851fc550f656753a8f4ff49da0deba0b22fbf057a" exitCode=1 May 31 17:23:32.130355 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.130334 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"7352739ae1036704bd1833dc48f1290199818c761b749364aa9cd402b6f48c16"} May 31 17:23:32.130389 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.130353 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerDied","Data":"ecb4d0d2f4c2889fb62f549851fc550f656753a8f4ff49da0deba0b22fbf057a"} May 31 17:23:32.130389 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.130369 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"d516c0876ae9defc24622aab9a308083c2a009300a57ca790af489f5286dfa83"} May 31 17:23:32.131996 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.131572 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n56bh" event={"ID":"2bbcf623-ebaf-4b6c-90ca-61040294570b","Type":"ContainerStarted","Data":"5487a7fe8ae8921154349d167b5dcb81de71e85197a66a9b69480bf0abc11cb4"} May 31 17:23:32.131996 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.131601 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n56bh" event={"ID":"2bbcf623-ebaf-4b6c-90ca-61040294570b","Type":"ContainerStarted","Data":"e4de3ef211c84353fe454d47dc823b8fd66b28983810225e61da567a05585c28"} May 31 17:23:32.133093 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.133070 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82gmj" event={"ID":"b728f509-ef8b-4f1c-bb3f-29595e7c510a","Type":"ContainerStarted","Data":"6c265bc85da24507fa11faeb1bdc23ae5fd83b65fd32ca0f1ab3a71ed6310c47"} May 31 17:23:32.134533 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.134511 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfqmk" event={"ID":"6e837042-0ec8-42f1-b1d3-e0a8a598c6df","Type":"ContainerStarted","Data":"7087d4318b29b27fa703f78e2d82e1ea4cd002e5b8e6a22c310be968e4354741"} May 31 17:23:32.212478 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.210972 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zfqmk" podStartSLOduration=3.097488151 podStartE2EDuration="21.210954014s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.407901047 +0000 UTC m=+3.004254576" lastFinishedPulling="2026-05-31 17:23:31.521366906 +0000 UTC m=+21.117720439" observedRunningTime="2026-05-31 17:23:32.209181589 +0000 UTC m=+21.805535129" watchObservedRunningTime="2026-05-31 17:23:32.210954014 +0000 UTC m=+21.807307557" May 31 17:23:32.271472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.271422 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-82gmj" podStartSLOduration=3.222125191 podStartE2EDuration="21.271405752s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.41014553 +0000 UTC m=+3.006499052" lastFinishedPulling="2026-05-31 17:23:31.459426083 +0000 UTC m=+21.055779613" observedRunningTime="2026-05-31 17:23:32.24438662 +0000 UTC m=+21.840740160" watchObservedRunningTime="2026-05-31 17:23:32.271405752 +0000 UTC m=+21.867759294" May 31 17:23:32.311135 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.311081 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9qfwd" podStartSLOduration=3.193126395 podStartE2EDuration="21.311064077s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.405131448 +0000 UTC m=+3.001484981" lastFinishedPulling="2026-05-31 17:23:31.523069124 +0000 UTC m=+21.119422663" observedRunningTime="2026-05-31 17:23:32.310808621 +0000 UTC m=+21.907162163" watchObservedRunningTime="2026-05-31 17:23:32.311064077 +0000 UTC m=+21.907417621" May 31 17:23:32.311565 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.311536 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-n56bh" podStartSLOduration=10.311525233 podStartE2EDuration="10.311525233s" podCreationTimestamp="2026-05-31 17:23:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:23:32.272263171 +0000 UTC m=+21.868616711" watchObservedRunningTime="2026-05-31 17:23:32.311525233 +0000 UTC m=+21.907878775" May 31 17:23:32.942654 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:32.942453 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:32.942780 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:32.942757 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:33.019307 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.019266 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 31 17:23:33.140487 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.140462 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:23:33.140892 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.140851 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"01f47714228c7fdb28f6ae04f48e9fbfd2be046d9287feae1ad6af1028667a09"} May 31 17:23:33.140892 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.140881 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"dc087c093ccf2415d1737750150ca6edb6294a4f89b89b369b7f0c56a766fe8c"} May 31 17:23:33.141037 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.140898 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"040893dfb85d37e3df5026e09a46c512751ddf4252467b27d32603bc8ad9b7f6"} May 31 17:23:33.142602 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.142185 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4l6jl" event={"ID":"c414b3f4-620c-4311-a25f-d5859fb2310b","Type":"ContainerStarted","Data":"958b6178e19b701afe0c1ea56fdec69dec1d7db05c09144a039a987c05902ae4"} May 31 17:23:33.143875 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.143847 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" event={"ID":"28599111-3933-484d-b7f7-8e751e149d5d","Type":"ContainerStarted","Data":"9ecb7dccf61c77eef327dfcb15564899e116fbaaa4135075b3593029bd8ea107"} May 31 17:23:33.196857 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.196803 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-d4zv2" podStartSLOduration=3.750062735 podStartE2EDuration="22.19678518s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.399330796 +0000 UTC m=+2.995684316" lastFinishedPulling="2026-05-31 17:23:31.846053222 +0000 UTC m=+21.442406761" observedRunningTime="2026-05-31 17:23:32.342782208 +0000 UTC m=+21.939135764" watchObservedRunningTime="2026-05-31 17:23:33.19678518 +0000 UTC m=+22.793138722" May 31 17:23:33.197053 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.197017 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4l6jl" podStartSLOduration=4.083490911 podStartE2EDuration="22.197009305s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.409056275 +0000 UTC m=+3.005409797" lastFinishedPulling="2026-05-31 17:23:31.522574657 +0000 UTC m=+21.118928191" observedRunningTime="2026-05-31 17:23:33.19668199 +0000 UTC m=+22.793035530" watchObservedRunningTime="2026-05-31 17:23:33.197009305 +0000 UTC m=+22.793362845" May 31 17:23:33.913216 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.913065 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-31T17:23:33.01928365Z","UUID":"147cd78a-709d-4c65-8216-adafc8fe34d7","Handler":null,"Name":"","Endpoint":""} May 31 17:23:33.915227 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.915188 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 31 17:23:33.915227 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.915220 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 31 17:23:33.942659 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.942629 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:33.942788 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:33.942629 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:33.942788 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:33.942765 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:33.942907 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:33.942813 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:34.243993 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:34.243959 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:34.244565 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:34.244544 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:34.942503 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:34.942468 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:34.942675 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:34.942578 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:35.149490 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.149450 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" event={"ID":"28599111-3933-484d-b7f7-8e751e149d5d","Type":"ContainerStarted","Data":"2a1b2dccd4e2557e1e9cc79877b03c87d8cccfb3c3c884a6da76694688d80cc2"} May 31 17:23:35.153062 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.153038 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:23:35.153437 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.153408 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"07f69cfef083c74dfd9833b6af048fbcaeb70843e8577d5032ad7c0601b6793b"} May 31 17:23:35.153669 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.153638 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:35.154171 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.154157 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-82gmj" May 31 17:23:35.211623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.211540 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pln8" podStartSLOduration=3.546814616 podStartE2EDuration="24.211526016s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.401963129 +0000 UTC m=+2.998316663" lastFinishedPulling="2026-05-31 17:23:34.066674541 +0000 UTC m=+23.663028063" observedRunningTime="2026-05-31 17:23:35.187738374 +0000 UTC m=+24.784091916" watchObservedRunningTime="2026-05-31 17:23:35.211526016 +0000 UTC m=+24.807879557" May 31 17:23:35.942388 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.942357 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:35.943014 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:35.942401 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:35.943014 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:35.942471 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:35.943014 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:35.942603 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:36.942599 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:36.942438 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:36.943130 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:36.942689 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:37.157336 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.157306 2567 generic.go:358] "Generic (PLEG): container finished" podID="d528d8dd-5562-424a-9d6c-f89b21044c54" containerID="c4fc43286367626335c662e068ba5c3a1fafc08f287aa648fa23761d378de651" exitCode=0 May 31 17:23:37.157501 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.157390 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerDied","Data":"c4fc43286367626335c662e068ba5c3a1fafc08f287aa648fa23761d378de651"} May 31 17:23:37.160309 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.160293 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:23:37.160612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.160589 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"e9e51aec5513505fd94bfbe30f9f229159b01c53f7a1498b283535355851b406"} May 31 17:23:37.161075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.160941 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:37.161075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.160966 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:37.161184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.161073 2567 scope.go:117] "RemoveContainer" containerID="ecb4d0d2f4c2889fb62f549851fc550f656753a8f4ff49da0deba0b22fbf057a" May 31 17:23:37.177089 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.177071 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:37.177172 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.177157 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:37.942884 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.942861 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:37.943233 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:37.942861 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:37.943233 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:37.943004 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:37.943233 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:37.943032 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:38.164479 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.164414 2567 generic.go:358] "Generic (PLEG): container finished" podID="d528d8dd-5562-424a-9d6c-f89b21044c54" containerID="09f5e708106a97faca7a71d2b1a03847b97c50d23f8c9f72f502542ddc7848b8" exitCode=0 May 31 17:23:38.164611 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.164504 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerDied","Data":"09f5e708106a97faca7a71d2b1a03847b97c50d23f8c9f72f502542ddc7848b8"} May 31 17:23:38.167758 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.167742 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:23:38.168097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.168077 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" event={"ID":"4f9e72db-3b0d-454c-a87c-a687dde7c6ff","Type":"ContainerStarted","Data":"cb0f7d6eb386a59f211728327c4acc340210f13d416a263eb465c8e66b8bd383"} May 31 17:23:38.168202 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.168191 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 31 17:23:38.304234 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.304055 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" podStartSLOduration=9.134338276 podStartE2EDuration="27.304041578s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.400914042 +0000 UTC m=+2.997267562" lastFinishedPulling="2026-05-31 17:23:31.570617335 +0000 UTC m=+21.166970864" observedRunningTime="2026-05-31 17:23:38.301103009 +0000 UTC m=+27.897456562" watchObservedRunningTime="2026-05-31 17:23:38.304041578 +0000 UTC m=+27.900395144" May 31 17:23:38.942269 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.942245 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:38.942367 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:38.942338 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:38.971833 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.971807 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jxzgt"] May 31 17:23:38.972258 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.971913 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:38.972258 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:38.972011 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:38.974048 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.974029 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44f6j"] May 31 17:23:38.974132 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:38.974112 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:38.974235 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:38.974200 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:39.001806 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:39.001738 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qhthc"] May 31 17:23:39.048306 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:39.048282 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:23:39.172394 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:39.172364 2567 generic.go:358] "Generic (PLEG): container finished" podID="d528d8dd-5562-424a-9d6c-f89b21044c54" containerID="c3bf452d3a414de16454ee3e2c22540cd9548ab7a32bedd64ccb8fc730e0a154" exitCode=0 May 31 17:23:39.172493 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:39.172431 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:39.172493 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:39.172441 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerDied","Data":"c3bf452d3a414de16454ee3e2c22540cd9548ab7a32bedd64ccb8fc730e0a154"} May 31 17:23:39.172654 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:39.172637 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:40.943489 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:40.943402 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:40.944060 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:40.943520 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:40.944060 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:40.943945 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:40.944171 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:40.944056 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:40.944171 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:40.944084 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:40.944171 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:40.944152 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:42.942950 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:42.942450 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:42.942950 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:42.942488 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:42.942950 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:42.942488 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:42.942950 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:42.942580 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:23:42.942950 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:42.942626 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44f6j" podUID="884d0a31-2b81-4a27-83db-9a93130a7da3" May 31 17:23:42.942950 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:42.942691 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhthc" podUID="f02aeb09-a0d9-4011-b5da-00f3ddf450d3" May 31 17:23:44.596148 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.595909 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:44.596525 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.596058 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:44.596525 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.596217 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.596199835 +0000 UTC m=+66.192553354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 31 17:23:44.697140 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.697108 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:44.697295 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.697156 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:44.697295 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.697251 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 31 17:23:44.697295 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.697267 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 31 17:23:44.697295 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.697266 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 31 17:23:44.697295 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.697277 2567 projected.go:194] Error preparing data for projected volume kube-api-access-6rrw2 for pod openshift-network-diagnostics/network-check-target-qhthc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:44.697485 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.697331 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret podName:884d0a31-2b81-4a27-83db-9a93130a7da3 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.697311906 +0000 UTC m=+66.293665439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret") pod "global-pull-secret-syncer-44f6j" (UID: "884d0a31-2b81-4a27-83db-9a93130a7da3") : object "kube-system"/"original-pull-secret" not registered May 31 17:23:44.697485 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:44.697351 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2 podName:f02aeb09-a0d9-4011-b5da-00f3ddf450d3 nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.697341423 +0000 UTC m=+66.293694957 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6rrw2" (UniqueName: "kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2") pod "network-check-target-qhthc" (UID: "f02aeb09-a0d9-4011-b5da-00f3ddf450d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 31 17:23:44.757140 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.757115 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-182.ec2.internal" event="NodeReady" May 31 17:23:44.757260 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.757239 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 31 17:23:44.860141 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.860085 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wh4cq"] May 31 17:23:44.880611 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.880590 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-59rwv"] May 31 17:23:44.880761 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.880747 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh4cq" May 31 17:23:44.888559 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.888535 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-777ll\"" May 31 17:23:44.888666 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.888606 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 31 17:23:44.888666 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.888612 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 31 17:23:44.909109 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.909087 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wh4cq"] May 31 17:23:44.909109 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.909110 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59rwv"] May 31 17:23:44.909231 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.909185 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:44.914716 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.914698 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 31 17:23:44.915065 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.915051 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 31 17:23:44.915434 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.915410 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p8png\"" May 31 17:23:44.916379 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.916363 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 31 17:23:44.942391 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.942373 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:23:44.942472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.942382 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:23:44.942556 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.942382 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:23:44.947015 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.946995 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 31 17:23:44.947097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.947021 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rdvr2\"" May 31 17:23:44.947367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.947338 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 31 17:23:44.947524 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.947386 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 31 17:23:44.947524 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.947490 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrg\"" May 31 17:23:44.948420 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.948404 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 31 17:23:44.998247 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.998223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:44.998334 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.998262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256k6\" (UniqueName: \"kubernetes.io/projected/255abd80-e011-4913-83ff-1c793ecbea8f-kube-api-access-256k6\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:44.998334 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.998283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/255abd80-e011-4913-83ff-1c793ecbea8f-config-volume\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:44.998334 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.998301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkhr\" (UniqueName: \"kubernetes.io/projected/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-kube-api-access-ggkhr\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:44.998495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.998341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255abd80-e011-4913-83ff-1c793ecbea8f-tmp-dir\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:44.998495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:44.998368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.098599 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.098577 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:45.098704 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.098610 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-256k6\" (UniqueName: \"kubernetes.io/projected/255abd80-e011-4913-83ff-1c793ecbea8f-kube-api-access-256k6\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.098704 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.098643 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/255abd80-e011-4913-83ff-1c793ecbea8f-config-volume\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.098807 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.098759 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:45.098807 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.098793 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkhr\" (UniqueName: \"kubernetes.io/projected/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-kube-api-access-ggkhr\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:45.098902 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.098818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:23:45.598797716 +0000 UTC m=+35.195151260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:23:45.098902 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.098888 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255abd80-e011-4913-83ff-1c793ecbea8f-tmp-dir\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.099031 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.098961 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.099085 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.099055 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:45.099139 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.099097 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:45.599083561 +0000 UTC m=+35.195437105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:23:45.099252 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.099235 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/255abd80-e011-4913-83ff-1c793ecbea8f-config-volume\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.099312 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.099274 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255abd80-e011-4913-83ff-1c793ecbea8f-tmp-dir\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.125078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.124993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-256k6\" (UniqueName: \"kubernetes.io/projected/255abd80-e011-4913-83ff-1c793ecbea8f-kube-api-access-256k6\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.129267 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.129240 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkhr\" (UniqueName: \"kubernetes.io/projected/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-kube-api-access-ggkhr\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:45.184951 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.184905 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerStarted","Data":"37224ff3a2b5dd9064e761bf6d6b5558b2d1f229ea5040e03d8063fc47fe4488"} May 31 17:23:45.602901 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.602871 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:45.603232 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:45.602916 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:45.603232 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.603029 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:45.603232 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.603029 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:45.603232 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.603089 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:23:46.603071362 +0000 UTC m=+36.199424887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:23:45.603232 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:45.603105 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:46.60309717 +0000 UTC m=+36.199450703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:23:46.189280 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:46.189244 2567 generic.go:358] "Generic (PLEG): container finished" podID="d528d8dd-5562-424a-9d6c-f89b21044c54" containerID="37224ff3a2b5dd9064e761bf6d6b5558b2d1f229ea5040e03d8063fc47fe4488" exitCode=0 May 31 17:23:46.189413 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:46.189310 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerDied","Data":"37224ff3a2b5dd9064e761bf6d6b5558b2d1f229ea5040e03d8063fc47fe4488"} May 31 17:23:46.610553 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:46.610523 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:46.610852 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:46.610566 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:46.610852 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:46.610652 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:46.610852 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:46.610655 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:46.610852 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:46.610703 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:23:48.610690085 +0000 UTC m=+38.207043616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:23:46.610852 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:46.610715 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:48.610709942 +0000 UTC m=+38.207063460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:23:47.193288 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:47.193261 2567 generic.go:358] "Generic (PLEG): container finished" podID="d528d8dd-5562-424a-9d6c-f89b21044c54" containerID="a46df58e5204a3def41c12dec1481da85144d243b0aaba7e215324ed33440718" exitCode=0 May 31 17:23:47.193431 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:47.193298 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerDied","Data":"a46df58e5204a3def41c12dec1481da85144d243b0aaba7e215324ed33440718"} May 31 17:23:48.198185 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:48.198152 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" event={"ID":"d528d8dd-5562-424a-9d6c-f89b21044c54","Type":"ContainerStarted","Data":"499e327c7985c20278c1ecd6321f1370dbc31133740e75d2496952afc77f79a8"} May 31 17:23:48.624078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:48.624052 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:48.624206 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:48.624119 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:48.624206 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:48.624189 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:48.624317 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:48.624212 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:48.624317 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:48.624258 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:23:52.624232232 +0000 UTC m=+42.220585751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:23:48.624317 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:48.624272 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:23:52.624266233 +0000 UTC m=+42.220619752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:23:52.648201 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:52.648025 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:23:52.648619 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:23:52.648217 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:23:52.648619 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:52.648166 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:23:52.648619 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:52.648338 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:23:52.648619 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:52.648339 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:24:00.648316964 +0000 UTC m=+50.244670505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:23:52.648619 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:23:52.648386 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:24:00.648369884 +0000 UTC m=+50.244723469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:24:00.698410 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:00.698378 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:24:00.699078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:00.698431 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:24:00.699078 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:00.698526 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:24:00.699078 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:00.698549 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:24:00.699078 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:00.698588 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.698571585 +0000 UTC m=+66.294925104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:24:00.699078 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:00.698602 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:24:16.698595813 +0000 UTC m=+66.294949332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:24:10.185394 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:10.185366 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdhhx" May 31 17:24:10.219158 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:10.219118 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6b6kg" podStartSLOduration=27.684542977 podStartE2EDuration="59.219105988s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:23:13.403497356 +0000 UTC m=+2.999850892" lastFinishedPulling="2026-05-31 17:23:44.938060383 +0000 UTC m=+34.534413903" observedRunningTime="2026-05-31 17:23:48.244630267 +0000 UTC m=+37.840983805" watchObservedRunningTime="2026-05-31 17:24:10.219105988 +0000 UTC m=+59.815459529" May 31 17:24:16.606183 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.606149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:24:16.609168 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.609150 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 31 17:24:16.616363 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:16.616344 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 31 17:24:16.616414 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:16.616403 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:20.61638192 +0000 UTC m=+130.212735464 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : secret "metrics-daemon-secret" not found May 31 17:24:16.706837 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.706814 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:24:16.706918 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.706846 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:24:16.706918 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.706868 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:24:16.706918 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.706883 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:24:16.707084 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:16.706978 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:24:16.707084 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:16.707005 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:24:16.707084 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:16.707023 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:24:48.707006379 +0000 UTC m=+98.303359912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:24:16.707084 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:16.707071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:24:48.707055316 +0000 UTC m=+98.303408859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:24:16.710174 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.710160 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 31 17:24:16.715889 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.715874 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 31 17:24:16.720478 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.720461 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 31 17:24:16.721264 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.721241 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/884d0a31-2b81-4a27-83db-9a93130a7da3-original-pull-secret\") pod \"global-pull-secret-syncer-44f6j\" (UID: \"884d0a31-2b81-4a27-83db-9a93130a7da3\") " pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:24:16.731038 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.731017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rrw2\" (UniqueName: \"kubernetes.io/projected/f02aeb09-a0d9-4011-b5da-00f3ddf450d3-kube-api-access-6rrw2\") pod \"network-check-target-qhthc\" (UID: \"f02aeb09-a0d9-4011-b5da-00f3ddf450d3\") " pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:24:16.755121 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.755102 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rdvr2\"" May 31 17:24:16.757162 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.757149 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44f6j" May 31 17:24:16.762590 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.762570 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:24:16.922184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.922156 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qhthc"] May 31 17:24:16.925848 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:24:16.925817 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02aeb09_a0d9_4011_b5da_00f3ddf450d3.slice/crio-44448a7a790c3f20526a0b89fc9f2c7ec448d63985c73ec0ac8573ccc7624884 WatchSource:0}: Error finding container 44448a7a790c3f20526a0b89fc9f2c7ec448d63985c73ec0ac8573ccc7624884: Status 404 returned error can't find the container with id 44448a7a790c3f20526a0b89fc9f2c7ec448d63985c73ec0ac8573ccc7624884 May 31 17:24:16.940682 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:16.940657 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44f6j"] May 31 17:24:17.249591 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:17.249515 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qhthc" event={"ID":"f02aeb09-a0d9-4011-b5da-00f3ddf450d3","Type":"ContainerStarted","Data":"44448a7a790c3f20526a0b89fc9f2c7ec448d63985c73ec0ac8573ccc7624884"} May 31 17:24:17.250585 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:17.250486 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44f6j" event={"ID":"884d0a31-2b81-4a27-83db-9a93130a7da3","Type":"ContainerStarted","Data":"8a401fbf45ae2887756ef861aedb1ddfd1b512d7e46ff492994e350ebf7ee563"} May 31 17:24:22.262060 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:22.262024 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qhthc" event={"ID":"f02aeb09-a0d9-4011-b5da-00f3ddf450d3","Type":"ContainerStarted","Data":"7d0ff01cf460f3684e27d1c6b38243a51cc048efe2096bed142af92c983ee953"} May 31 17:24:22.262588 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:22.262164 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:24:22.263339 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:22.263315 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44f6j" event={"ID":"884d0a31-2b81-4a27-83db-9a93130a7da3","Type":"ContainerStarted","Data":"03daf6ac2061758333e59b6678f8898dd98eaa788a71aaa28ad5b4f6e101a707"} May 31 17:24:22.299802 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:22.299752 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qhthc" podStartSLOduration=67.016794212 podStartE2EDuration="1m11.29974084s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:24:16.927596094 +0000 UTC m=+66.523949614" lastFinishedPulling="2026-05-31 17:24:21.210542709 +0000 UTC m=+70.806896242" observedRunningTime="2026-05-31 17:24:22.299426208 +0000 UTC m=+71.895779749" watchObservedRunningTime="2026-05-31 17:24:22.29974084 +0000 UTC m=+71.896094381" May 31 17:24:22.338963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:22.338900 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-44f6j" podStartSLOduration=66.072599523 podStartE2EDuration="1m10.338888484s" podCreationTimestamp="2026-05-31 17:23:12 +0000 UTC" firstStartedPulling="2026-05-31 17:24:16.947458451 +0000 UTC m=+66.543811970" lastFinishedPulling="2026-05-31 17:24:21.213747412 +0000 UTC m=+70.810100931" observedRunningTime="2026-05-31 17:24:22.338637326 +0000 UTC m=+71.934990866" watchObservedRunningTime="2026-05-31 17:24:22.338888484 +0000 UTC m=+71.935242016" May 31 17:24:48.722692 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:48.722604 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:24:48.722692 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:48.722642 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:24:48.723128 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:48.722746 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:24:48.723128 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:48.722755 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:24:48.723128 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:48.722797 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:25:52.722783268 +0000 UTC m=+162.319136787 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:24:48.723128 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:24:48.722817 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:25:52.722802705 +0000 UTC m=+162.319156224 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:24:53.267220 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:24:53.267187 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qhthc" May 31 17:25:20.625984 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:20.625947 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:25:20.626445 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:20.626076 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 31 17:25:20.626445 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:20.626146 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs podName:4841495e-5e34-474b-bf38-40a32da540f9 nodeName:}" failed. No retries permitted until 2026-05-31 17:27:22.626130353 +0000 UTC m=+252.222483889 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs") pod "network-metrics-daemon-jxzgt" (UID: "4841495e-5e34-474b-bf38-40a32da540f9") : secret "metrics-daemon-secret" not found May 31 17:25:33.489226 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.489191 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4"] May 31 17:25:33.492097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.492081 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.495574 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.495549 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 31 17:25:33.496287 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.496265 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d7849d7f7-9n294"] May 31 17:25:33.496640 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.496616 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 31 17:25:33.496640 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.496639 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6z9sg\"" May 31 17:25:33.496774 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.496648 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 31 17:25:33.498043 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.498024 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 31 17:25:33.499198 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.499180 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.503169 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.503152 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 31 17:25:33.503327 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.503305 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zfz5z\"" May 31 17:25:33.503392 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.503342 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 31 17:25:33.508110 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.508089 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 31 17:25:33.508220 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.508088 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 31 17:25:33.508220 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.508126 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 31 17:25:33.508220 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.508166 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 31 17:25:33.508889 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.508871 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4"] May 31 17:25:33.519321 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.519300 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d7849d7f7-9n294"] May 31 17:25:33.611037 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.611169 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc802361-95fa-44b0-bae4-3c943c759bda-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.611169 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.611169 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cwg\" (UniqueName: \"kubernetes.io/projected/92937b26-0004-46b5-ab90-bf4be66b2e79-kube-api-access-q4cwg\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.611265 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xl5\" (UniqueName: \"kubernetes.io/projected/bc802361-95fa-44b0-bae4-3c943c759bda-kube-api-access-s9xl5\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.611265 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-default-certificate\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.611265 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.611265 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.611255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-stats-auth\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.712259 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.712259 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712263 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-stats-auth\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.712360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712297 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.712360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712321 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc802361-95fa-44b0-bae4-3c943c759bda-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.712360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.712473 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712374 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cwg\" (UniqueName: \"kubernetes.io/projected/92937b26-0004-46b5-ab90-bf4be66b2e79-kube-api-access-q4cwg\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.712473 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:33.712396 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 31 17:25:33.712473 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:33.712406 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:34.212387673 +0000 UTC m=+143.808741211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : configmap references non-existent config key: service-ca.crt May 31 17:25:33.712473 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:33.712446 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:34.212434666 +0000 UTC m=+143.808788240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : secret "router-metrics-certs-default" not found May 31 17:25:33.712473 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712469 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xl5\" (UniqueName: \"kubernetes.io/projected/bc802361-95fa-44b0-bae4-3c943c759bda-kube-api-access-s9xl5\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.712868 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:33.712487 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 31 17:25:33.712868 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.712492 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-default-certificate\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.712868 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:33.712543 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls podName:bc802361-95fa-44b0-bae4-3c943c759bda nodeName:}" failed. No retries permitted until 2026-05-31 17:25:34.212525815 +0000 UTC m=+143.808879334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mvgj4" (UID: "bc802361-95fa-44b0-bae4-3c943c759bda") : secret "cluster-monitoring-operator-tls" not found May 31 17:25:33.713032 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.713015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc802361-95fa-44b0-bae4-3c943c759bda-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:33.714885 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.714864 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-stats-auth\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.714885 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.714884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-default-certificate\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.721082 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.721056 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cwg\" (UniqueName: \"kubernetes.io/projected/92937b26-0004-46b5-ab90-bf4be66b2e79-kube-api-access-q4cwg\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:33.721201 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:33.721184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xl5\" (UniqueName: \"kubernetes.io/projected/bc802361-95fa-44b0-bae4-3c943c759bda-kube-api-access-s9xl5\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:34.216522 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:34.216489 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:34.216666 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:34.216539 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:34.216666 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:34.216558 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:34.216666 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:34.216631 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:35.216615664 +0000 UTC m=+144.812969187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : configmap references non-existent config key: service-ca.crt May 31 17:25:34.216666 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:34.216633 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 31 17:25:34.216666 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:34.216658 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 31 17:25:34.216859 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:34.216664 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls podName:bc802361-95fa-44b0-bae4-3c943c759bda nodeName:}" failed. No retries permitted until 2026-05-31 17:25:35.216658209 +0000 UTC m=+144.813011767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mvgj4" (UID: "bc802361-95fa-44b0-bae4-3c943c759bda") : secret "cluster-monitoring-operator-tls" not found May 31 17:25:34.216859 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:34.216726 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:35.21670503 +0000 UTC m=+144.813058550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : secret "router-metrics-certs-default" not found May 31 17:25:35.224154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:35.224117 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:35.224168 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:35.224240 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:35.224260 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:37.224242021 +0000 UTC m=+146.820595546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : configmap references non-existent config key: service-ca.crt May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:35.224288 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:37.224271909 +0000 UTC m=+146.820625429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : secret "router-metrics-certs-default" not found May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:35.224306 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:35.224371 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 31 17:25:35.224529 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:35.224398 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls podName:bc802361-95fa-44b0-bae4-3c943c759bda nodeName:}" failed. No retries permitted until 2026-05-31 17:25:37.224390777 +0000 UTC m=+146.820744296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mvgj4" (UID: "bc802361-95fa-44b0-bae4-3c943c759bda") : secret "cluster-monitoring-operator-tls" not found May 31 17:25:36.549782 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.549754 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656"] May 31 17:25:36.552798 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.552781 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:36.555621 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.555601 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 31 17:25:36.555754 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.555647 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zm2rk\"" May 31 17:25:36.556244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.556226 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 31 17:25:36.556663 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.556646 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 31 17:25:36.564262 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.564243 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656"] May 31 17:25:36.633687 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.633662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:36.633799 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.633779 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxl9\" (UniqueName: \"kubernetes.io/projected/2d7bafb9-8e12-4e26-9249-f30d02c98082-kube-api-access-nwxl9\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:36.734513 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.734491 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxl9\" (UniqueName: \"kubernetes.io/projected/2d7bafb9-8e12-4e26-9249-f30d02c98082-kube-api-access-nwxl9\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:36.734578 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.734525 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:36.734617 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:36.734608 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 31 17:25:36.734677 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:36.734669 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls podName:2d7bafb9-8e12-4e26-9249-f30d02c98082 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:37.234655669 +0000 UTC m=+146.831009188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xn656" (UID: "2d7bafb9-8e12-4e26-9249-f30d02c98082") : secret "samples-operator-tls" not found May 31 17:25:36.743125 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:36.743109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxl9\" (UniqueName: \"kubernetes.io/projected/2d7bafb9-8e12-4e26-9249-f30d02c98082-kube-api-access-nwxl9\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:37.238254 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:37.238229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:37.238395 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:37.238274 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:37.238395 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:37.238294 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:37.238395 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238391 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 31 17:25:37.238497 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238391 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 31 17:25:37.238497 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238392 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:41.238375365 +0000 UTC m=+150.834728885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : configmap references non-existent config key: service-ca.crt May 31 17:25:37.238497 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:37.238452 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:37.238497 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238492 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:41.238479962 +0000 UTC m=+150.834833481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : secret "router-metrics-certs-default" not found May 31 17:25:37.238620 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238510 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls podName:bc802361-95fa-44b0-bae4-3c943c759bda nodeName:}" failed. No retries permitted until 2026-05-31 17:25:41.238499497 +0000 UTC m=+150.834853017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mvgj4" (UID: "bc802361-95fa-44b0-bae4-3c943c759bda") : secret "cluster-monitoring-operator-tls" not found May 31 17:25:37.238620 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238534 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 31 17:25:37.238620 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:37.238588 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls podName:2d7bafb9-8e12-4e26-9249-f30d02c98082 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:38.238575558 +0000 UTC m=+147.834929077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xn656" (UID: "2d7bafb9-8e12-4e26-9249-f30d02c98082") : secret "samples-operator-tls" not found May 31 17:25:38.244978 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:38.244951 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:38.245338 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:38.245088 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 31 17:25:38.245338 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:38.245145 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls podName:2d7bafb9-8e12-4e26-9249-f30d02c98082 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:40.245131356 +0000 UTC m=+149.841484882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xn656" (UID: "2d7bafb9-8e12-4e26-9249-f30d02c98082") : secret "samples-operator-tls" not found May 31 17:25:39.091544 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:39.091517 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n56bh_2bbcf623-ebaf-4b6c-90ca-61040294570b/dns-node-resolver/0.log" May 31 17:25:40.091731 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:40.091701 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfqmk_6e837042-0ec8-42f1-b1d3-e0a8a598c6df/node-ca/0.log" May 31 17:25:40.260790 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:40.260762 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:40.260979 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:40.260950 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 31 17:25:40.261048 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:40.261027 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls podName:2d7bafb9-8e12-4e26-9249-f30d02c98082 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:44.261005329 +0000 UTC m=+153.857358849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xn656" (UID: "2d7bafb9-8e12-4e26-9249-f30d02c98082") : secret "samples-operator-tls" not found May 31 17:25:41.268720 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:41.268688 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:41.268720 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:41.268729 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:41.269159 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:41.268796 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:41.269159 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:41.268913 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:49.268896829 +0000 UTC m=+158.865250352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : configmap references non-existent config key: service-ca.crt May 31 17:25:41.269159 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:41.269020 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 31 17:25:41.269159 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:41.269082 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 31 17:25:41.269159 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:41.269091 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:49.269073434 +0000 UTC m=+158.865426969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : secret "router-metrics-certs-default" not found May 31 17:25:41.269159 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:41.269137 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls podName:bc802361-95fa-44b0-bae4-3c943c759bda nodeName:}" failed. No retries permitted until 2026-05-31 17:25:49.269123324 +0000 UTC m=+158.865476845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mvgj4" (UID: "bc802361-95fa-44b0-bae4-3c943c759bda") : secret "cluster-monitoring-operator-tls" not found May 31 17:25:44.290017 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.289975 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:44.290377 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:44.290116 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 31 17:25:44.290377 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:44.290187 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls podName:2d7bafb9-8e12-4e26-9249-f30d02c98082 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:52.290168347 +0000 UTC m=+161.886521886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xn656" (UID: "2d7bafb9-8e12-4e26-9249-f30d02c98082") : secret "samples-operator-tls" not found May 31 17:25:44.328254 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.328228 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-795fb89dd6-xcv8t"] May 31 17:25:44.331248 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.331233 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.333956 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.333915 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 31 17:25:44.334282 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.334265 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9j7s\"" May 31 17:25:44.334375 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.334356 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 31 17:25:44.334411 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.334394 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 31 17:25:44.340856 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.340831 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 31 17:25:44.348781 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.348752 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795fb89dd6-xcv8t"] May 31 17:25:44.492179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/062d0507-7703-41b9-9c48-09d3a3b25d37-ca-trust-extracted\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492345 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-bound-sa-token\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492345 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94c7h\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-kube-api-access-94c7h\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492345 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-image-registry-private-configuration\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-certificates\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-trusted-ca\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.492448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.492388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-installation-pull-secrets\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593042 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593006 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-certificates\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593150 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593051 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-trusted-ca\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593150 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593071 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-installation-pull-secrets\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593305 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593263 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/062d0507-7703-41b9-9c48-09d3a3b25d37-ca-trust-extracted\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593339 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593327 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593445 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:44.593420 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 31 17:25:44.593445 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:44.593442 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795fb89dd6-xcv8t: secret "image-registry-tls" not found May 31 17:25:44.593567 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593454 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-bound-sa-token\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593567 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:44.593500 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls podName:062d0507-7703-41b9-9c48-09d3a3b25d37 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:45.093479663 +0000 UTC m=+154.689833197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls") pod "image-registry-795fb89dd6-xcv8t" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37") : secret "image-registry-tls" not found May 31 17:25:44.593567 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593520 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94c7h\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-kube-api-access-94c7h\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593708 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593589 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-image-registry-private-configuration\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593708 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593647 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/062d0507-7703-41b9-9c48-09d3a3b25d37-ca-trust-extracted\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.593800 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.593731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-certificates\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.594322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.594294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-trusted-ca\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.595774 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.595756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-installation-pull-secrets\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.595879 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.595840 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-image-registry-private-configuration\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.604900 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.604876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-bound-sa-token\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:44.605772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:44.605754 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94c7h\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-kube-api-access-94c7h\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:45.097059 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.097031 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:45.097215 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:45.097133 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 31 17:25:45.097215 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:45.097144 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795fb89dd6-xcv8t: secret "image-registry-tls" not found May 31 17:25:45.097215 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:45.097197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls podName:062d0507-7703-41b9-9c48-09d3a3b25d37 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:46.097183453 +0000 UTC m=+155.693536972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls") pod "image-registry-795fb89dd6-xcv8t" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37") : secret "image-registry-tls" not found May 31 17:25:45.217075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.217044 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks"] May 31 17:25:45.221052 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.221026 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" May 31 17:25:45.223532 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.223507 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 31 17:25:45.223684 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.223575 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 31 17:25:45.223684 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.223645 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5xmsx\"" May 31 17:25:45.229745 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.229723 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks"] May 31 17:25:45.298182 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.298151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbw9\" (UniqueName: \"kubernetes.io/projected/6c741caf-4d9b-483a-8de2-bc412a3b763e-kube-api-access-2lbw9\") pod \"migrator-96c6f749-4q9ks\" (UID: \"6c741caf-4d9b-483a-8de2-bc412a3b763e\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" May 31 17:25:45.398951 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.398860 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbw9\" (UniqueName: \"kubernetes.io/projected/6c741caf-4d9b-483a-8de2-bc412a3b763e-kube-api-access-2lbw9\") pod \"migrator-96c6f749-4q9ks\" (UID: \"6c741caf-4d9b-483a-8de2-bc412a3b763e\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" May 31 17:25:45.407170 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.407147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbw9\" (UniqueName: \"kubernetes.io/projected/6c741caf-4d9b-483a-8de2-bc412a3b763e-kube-api-access-2lbw9\") pod \"migrator-96c6f749-4q9ks\" (UID: \"6c741caf-4d9b-483a-8de2-bc412a3b763e\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" May 31 17:25:45.531022 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.530990 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" May 31 17:25:45.647402 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:45.647368 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks"] May 31 17:25:45.650471 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:25:45.650421 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c741caf_4d9b_483a_8de2_bc412a3b763e.slice/crio-cf7e2a696bcce687fc106b9e8668d280e20771542a09511f9f95e3ebd5bec8b0 WatchSource:0}: Error finding container cf7e2a696bcce687fc106b9e8668d280e20771542a09511f9f95e3ebd5bec8b0: Status 404 returned error can't find the container with id cf7e2a696bcce687fc106b9e8668d280e20771542a09511f9f95e3ebd5bec8b0 May 31 17:25:46.103777 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:46.103750 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:46.103959 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:46.103874 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 31 17:25:46.103959 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:46.103887 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795fb89dd6-xcv8t: secret "image-registry-tls" not found May 31 17:25:46.104056 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:46.103965 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls podName:062d0507-7703-41b9-9c48-09d3a3b25d37 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:48.103945153 +0000 UTC m=+157.700298690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls") pod "image-registry-795fb89dd6-xcv8t" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37") : secret "image-registry-tls" not found May 31 17:25:46.423350 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:46.423224 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" event={"ID":"6c741caf-4d9b-483a-8de2-bc412a3b763e","Type":"ContainerStarted","Data":"cf7e2a696bcce687fc106b9e8668d280e20771542a09511f9f95e3ebd5bec8b0"} May 31 17:25:47.426448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:47.426415 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" event={"ID":"6c741caf-4d9b-483a-8de2-bc412a3b763e","Type":"ContainerStarted","Data":"bdcaacc8dba1727599ba3da24971296958723ca34b970510ce8a4539af55049b"} May 31 17:25:47.426448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:47.426449 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" event={"ID":"6c741caf-4d9b-483a-8de2-bc412a3b763e","Type":"ContainerStarted","Data":"2df93f13b38d77c0edb2f897425aea73e796bfc925728b46b9e0fd4ffa9cd3f7"} May 31 17:25:47.443665 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:47.443616 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4q9ks" podStartSLOduration=1.122057257 podStartE2EDuration="2.443605263s" podCreationTimestamp="2026-05-31 17:25:45 +0000 UTC" firstStartedPulling="2026-05-31 17:25:45.652674393 +0000 UTC m=+155.249027912" lastFinishedPulling="2026-05-31 17:25:46.974222399 +0000 UTC m=+156.570575918" observedRunningTime="2026-05-31 17:25:47.443220746 +0000 UTC m=+157.039574293" watchObservedRunningTime="2026-05-31 17:25:47.443605263 +0000 UTC m=+157.039958804" May 31 17:25:47.890092 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:47.890054 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wh4cq" podUID="255abd80-e011-4913-83ff-1c793ecbea8f" May 31 17:25:47.917702 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:47.917664 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-59rwv" podUID="e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b" May 31 17:25:47.964139 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:47.964116 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jxzgt" podUID="4841495e-5e34-474b-bf38-40a32da540f9" May 31 17:25:48.118965 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:48.118932 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:48.119077 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:48.119032 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 31 17:25:48.119077 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:48.119053 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795fb89dd6-xcv8t: secret "image-registry-tls" not found May 31 17:25:48.119176 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:48.119121 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls podName:062d0507-7703-41b9-9c48-09d3a3b25d37 nodeName:}" failed. No retries permitted until 2026-05-31 17:25:52.119100343 +0000 UTC m=+161.715453904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls") pod "image-registry-795fb89dd6-xcv8t" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37") : secret "image-registry-tls" not found May 31 17:25:48.428544 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:48.428517 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh4cq" May 31 17:25:49.328748 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:49.328714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:49.328916 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:49.328754 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:25:49.328916 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:49.328811 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:25:49.328916 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:49.328856 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 31 17:25:49.329051 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:49.328942 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:26:05.328906615 +0000 UTC m=+174.925260147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : configmap references non-existent config key: service-ca.crt May 31 17:25:49.329051 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:49.328950 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 31 17:25:49.329051 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:49.328964 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs podName:92937b26-0004-46b5-ab90-bf4be66b2e79 nodeName:}" failed. No retries permitted until 2026-05-31 17:26:05.328953496 +0000 UTC m=+174.925307015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs") pod "router-default-d7849d7f7-9n294" (UID: "92937b26-0004-46b5-ab90-bf4be66b2e79") : secret "router-metrics-certs-default" not found May 31 17:25:49.329051 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:49.329013 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls podName:bc802361-95fa-44b0-bae4-3c943c759bda nodeName:}" failed. No retries permitted until 2026-05-31 17:26:05.328995378 +0000 UTC m=+174.925348901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mvgj4" (UID: "bc802361-95fa-44b0-bae4-3c943c759bda") : secret "cluster-monitoring-operator-tls" not found May 31 17:25:50.539000 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.538956 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8n4dm"] May 31 17:25:50.541886 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.541867 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.544400 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.544372 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 31 17:25:50.544745 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.544725 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 31 17:25:50.545498 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.545477 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 31 17:25:50.545592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.545527 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 31 17:25:50.545630 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.545527 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dn54w\"" May 31 17:25:50.550663 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.550635 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8n4dm"] May 31 17:25:50.636842 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.636816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.636996 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.636853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrxk9\" (UniqueName: \"kubernetes.io/projected/af971b20-f790-4168-88b0-f1f44cc0347d-kube-api-access-nrxk9\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.636996 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.636916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af971b20-f790-4168-88b0-f1f44cc0347d-data-volume\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.637077 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.637001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af971b20-f790-4168-88b0-f1f44cc0347d-crio-socket\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.637077 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.637028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af971b20-f790-4168-88b0-f1f44cc0347d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738165 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738133 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af971b20-f790-4168-88b0-f1f44cc0347d-crio-socket\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738241 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738180 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af971b20-f790-4168-88b0-f1f44cc0347d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738289 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738250 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af971b20-f790-4168-88b0-f1f44cc0347d-crio-socket\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738289 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738281 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738373 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738302 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxk9\" (UniqueName: \"kubernetes.io/projected/af971b20-f790-4168-88b0-f1f44cc0347d-kube-api-access-nrxk9\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738373 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738343 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af971b20-f790-4168-88b0-f1f44cc0347d-data-volume\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.738464 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:50.738448 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:50.738546 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:50.738532 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls podName:af971b20-f790-4168-88b0-f1f44cc0347d nodeName:}" failed. No retries permitted until 2026-05-31 17:25:51.238516836 +0000 UTC m=+160.834870368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n4dm" (UID: "af971b20-f790-4168-88b0-f1f44cc0347d") : secret "insights-runtime-extractor-tls" not found May 31 17:25:50.738611 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.738581 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af971b20-f790-4168-88b0-f1f44cc0347d-data-volume\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.739353 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.739335 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af971b20-f790-4168-88b0-f1f44cc0347d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:50.747476 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:50.747459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrxk9\" (UniqueName: \"kubernetes.io/projected/af971b20-f790-4168-88b0-f1f44cc0347d-kube-api-access-nrxk9\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:51.242154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:51.242129 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:51.242280 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:51.242256 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:51.242321 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:51.242305 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls podName:af971b20-f790-4168-88b0-f1f44cc0347d nodeName:}" failed. No retries permitted until 2026-05-31 17:25:52.242291636 +0000 UTC m=+161.838645156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n4dm" (UID: "af971b20-f790-4168-88b0-f1f44cc0347d") : secret "insights-runtime-extractor-tls" not found May 31 17:25:52.148518 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.148488 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:25:52.148878 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.148625 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 31 17:25:52.148878 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.148642 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-795fb89dd6-xcv8t: secret "image-registry-tls" not found May 31 17:25:52.148878 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.148696 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls podName:062d0507-7703-41b9-9c48-09d3a3b25d37 nodeName:}" failed. No retries permitted until 2026-05-31 17:26:00.148677502 +0000 UTC m=+169.745031021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls") pod "image-registry-795fb89dd6-xcv8t" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37") : secret "image-registry-tls" not found May 31 17:25:52.248890 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.248858 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:52.249050 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.248972 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:52.249050 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.249019 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls podName:af971b20-f790-4168-88b0-f1f44cc0347d nodeName:}" failed. No retries permitted until 2026-05-31 17:25:54.249006195 +0000 UTC m=+163.845359714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n4dm" (UID: "af971b20-f790-4168-88b0-f1f44cc0347d") : secret "insights-runtime-extractor-tls" not found May 31 17:25:52.349253 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.349226 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:52.351626 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.351604 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d7bafb9-8e12-4e26-9249-f30d02c98082-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xn656\" (UID: \"2d7bafb9-8e12-4e26-9249-f30d02c98082\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:52.461861 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.461801 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" May 31 17:25:52.582217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.582190 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656"] May 31 17:25:52.752952 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.752874 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:25:52.752952 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:52.752913 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:25:52.753083 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.753014 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 31 17:25:52.753083 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.753021 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 31 17:25:52.753083 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.753069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls podName:255abd80-e011-4913-83ff-1c793ecbea8f nodeName:}" failed. No retries permitted until 2026-05-31 17:27:54.753056064 +0000 UTC m=+284.349409583 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls") pod "dns-default-wh4cq" (UID: "255abd80-e011-4913-83ff-1c793ecbea8f") : secret "dns-default-metrics-tls" not found May 31 17:25:52.753083 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:52.753082 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert podName:e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b nodeName:}" failed. No retries permitted until 2026-05-31 17:27:54.75307631 +0000 UTC m=+284.349429828 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert") pod "ingress-canary-59rwv" (UID: "e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b") : secret "canary-serving-cert" not found May 31 17:25:53.439498 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:53.439457 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" event={"ID":"2d7bafb9-8e12-4e26-9249-f30d02c98082","Type":"ContainerStarted","Data":"d4013da0b04965961b854863a200e230e65e960a0000cc79b69647867569af42"} May 31 17:25:54.265882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:54.265849 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:54.266039 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:54.266006 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 31 17:25:54.266079 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:25:54.266071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls podName:af971b20-f790-4168-88b0-f1f44cc0347d nodeName:}" failed. No retries permitted until 2026-05-31 17:25:58.266056127 +0000 UTC m=+167.862409646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n4dm" (UID: "af971b20-f790-4168-88b0-f1f44cc0347d") : secret "insights-runtime-extractor-tls" not found May 31 17:25:54.444060 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:54.444029 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" event={"ID":"2d7bafb9-8e12-4e26-9249-f30d02c98082","Type":"ContainerStarted","Data":"1ed16d39eb4885e394ba28a856b23ec7d71f4729dd8a58c8c6a65c58877827ac"} May 31 17:25:54.444398 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:54.444074 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" event={"ID":"2d7bafb9-8e12-4e26-9249-f30d02c98082","Type":"ContainerStarted","Data":"3b124b86c2acbee1ab491f7cac20ca19073ab749111225917006baf7ee02abf3"} May 31 17:25:54.460904 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:54.460845 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xn656" podStartSLOduration=16.777895779 podStartE2EDuration="18.460826216s" podCreationTimestamp="2026-05-31 17:25:36 +0000 UTC" firstStartedPulling="2026-05-31 17:25:52.6234357 +0000 UTC m=+162.219789219" lastFinishedPulling="2026-05-31 17:25:54.306366133 +0000 UTC m=+163.902719656" observedRunningTime="2026-05-31 17:25:54.459645261 +0000 UTC m=+164.055998802" watchObservedRunningTime="2026-05-31 17:25:54.460826216 +0000 UTC m=+164.057179756" May 31 17:25:58.301985 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:58.301876 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:58.304358 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:58.304333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af971b20-f790-4168-88b0-f1f44cc0347d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n4dm\" (UID: \"af971b20-f790-4168-88b0-f1f44cc0347d\") " pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:58.350603 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:58.350571 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8n4dm" May 31 17:25:58.480285 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:58.480249 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8n4dm"] May 31 17:25:58.483682 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:25:58.483654 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf971b20_f790_4168_88b0_f1f44cc0347d.slice/crio-5098682e2a2e066037b1e0968ad0035165e8337746a2184a9ed27de6cf6d6613 WatchSource:0}: Error finding container 5098682e2a2e066037b1e0968ad0035165e8337746a2184a9ed27de6cf6d6613: Status 404 returned error can't find the container with id 5098682e2a2e066037b1e0968ad0035165e8337746a2184a9ed27de6cf6d6613 May 31 17:25:58.942178 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:58.942142 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:25:59.458614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:59.458536 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n4dm" event={"ID":"af971b20-f790-4168-88b0-f1f44cc0347d","Type":"ContainerStarted","Data":"f2b21492604096ff114bfab35b998993287b31f12b2d2641f26e6c4e5c1bfd74"} May 31 17:25:59.458614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:59.458569 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n4dm" event={"ID":"af971b20-f790-4168-88b0-f1f44cc0347d","Type":"ContainerStarted","Data":"9b52b8f8c56308171bf73ee737de5c8508fcc0ceec1864a8bf63ecb261400f7f"} May 31 17:25:59.458614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:25:59.458578 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n4dm" event={"ID":"af971b20-f790-4168-88b0-f1f44cc0347d","Type":"ContainerStarted","Data":"5098682e2a2e066037b1e0968ad0035165e8337746a2184a9ed27de6cf6d6613"} May 31 17:26:00.217385 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:00.217352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:26:00.220049 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:00.220022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"image-registry-795fb89dd6-xcv8t\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:26:00.240861 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:00.240822 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:26:00.774650 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:00.774627 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795fb89dd6-xcv8t"] May 31 17:26:00.777252 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:00.777226 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062d0507_7703_41b9_9c48_09d3a3b25d37.slice/crio-718e53c1d51f54271ba90449f8678b280ad51e9fd967d0901397cbc214da4186 WatchSource:0}: Error finding container 718e53c1d51f54271ba90449f8678b280ad51e9fd967d0901397cbc214da4186: Status 404 returned error can't find the container with id 718e53c1d51f54271ba90449f8678b280ad51e9fd967d0901397cbc214da4186 May 31 17:26:01.469809 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:01.469775 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n4dm" event={"ID":"af971b20-f790-4168-88b0-f1f44cc0347d","Type":"ContainerStarted","Data":"3f5c387c990807cfa372b433e7cca461a127c9b4c53de3adf21f4e7f8387c9b0"} May 31 17:26:01.471127 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:01.471096 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" event={"ID":"062d0507-7703-41b9-9c48-09d3a3b25d37","Type":"ContainerStarted","Data":"10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d"} May 31 17:26:01.471127 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:01.471123 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" event={"ID":"062d0507-7703-41b9-9c48-09d3a3b25d37","Type":"ContainerStarted","Data":"718e53c1d51f54271ba90449f8678b280ad51e9fd967d0901397cbc214da4186"} May 31 17:26:01.471314 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:01.471222 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:26:01.492300 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:01.492261 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8n4dm" podStartSLOduration=9.329978679 podStartE2EDuration="11.492248777s" podCreationTimestamp="2026-05-31 17:25:50 +0000 UTC" firstStartedPulling="2026-05-31 17:25:58.536592504 +0000 UTC m=+168.132946023" lastFinishedPulling="2026-05-31 17:26:00.698862584 +0000 UTC m=+170.295216121" observedRunningTime="2026-05-31 17:26:01.492075917 +0000 UTC m=+171.088429457" watchObservedRunningTime="2026-05-31 17:26:01.492248777 +0000 UTC m=+171.088602334" May 31 17:26:01.515378 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:01.515343 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" podStartSLOduration=17.515331161 podStartE2EDuration="17.515331161s" podCreationTimestamp="2026-05-31 17:25:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:26:01.514370782 +0000 UTC m=+171.110724324" watchObservedRunningTime="2026-05-31 17:26:01.515331161 +0000 UTC m=+171.111684702" May 31 17:26:02.941984 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:02.941954 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:26:05.359151 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.359117 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:05.359151 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.359154 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:05.359550 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.359211 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:26:05.359686 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.359664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92937b26-0004-46b5-ab90-bf4be66b2e79-service-ca-bundle\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:05.361872 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.361848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc802361-95fa-44b0-bae4-3c943c759bda-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mvgj4\" (UID: \"bc802361-95fa-44b0-bae4-3c943c759bda\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:26:05.361952 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.361848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92937b26-0004-46b5-ab90-bf4be66b2e79-metrics-certs\") pod \"router-default-d7849d7f7-9n294\" (UID: \"92937b26-0004-46b5-ab90-bf4be66b2e79\") " pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:05.601631 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.601600 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" May 31 17:26:05.608249 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.608228 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:05.745744 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.745713 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4"] May 31 17:26:05.750340 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:05.750313 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc802361_95fa_44b0_bae4_3c943c759bda.slice/crio-872f49bdee68108f32a5252d028e306827e8965898bbeb1e51a0d57d865adeb5 WatchSource:0}: Error finding container 872f49bdee68108f32a5252d028e306827e8965898bbeb1e51a0d57d865adeb5: Status 404 returned error can't find the container with id 872f49bdee68108f32a5252d028e306827e8965898bbeb1e51a0d57d865adeb5 May 31 17:26:05.763115 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:05.763090 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d7849d7f7-9n294"] May 31 17:26:05.765761 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:05.765731 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92937b26_0004_46b5_ab90_bf4be66b2e79.slice/crio-4f4f76b131d8dbf15c8dc4613a1405b75243914d7e10c2f9c01aef411ca9260a WatchSource:0}: Error finding container 4f4f76b131d8dbf15c8dc4613a1405b75243914d7e10c2f9c01aef411ca9260a: Status 404 returned error can't find the container with id 4f4f76b131d8dbf15c8dc4613a1405b75243914d7e10c2f9c01aef411ca9260a May 31 17:26:06.485318 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:06.485286 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d7849d7f7-9n294" event={"ID":"92937b26-0004-46b5-ab90-bf4be66b2e79","Type":"ContainerStarted","Data":"0190ea87d90d506da945cb3e789360188ce590ab8d62b69d78980a30d9c03bd6"} May 31 17:26:06.485791 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:06.485325 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d7849d7f7-9n294" event={"ID":"92937b26-0004-46b5-ab90-bf4be66b2e79","Type":"ContainerStarted","Data":"4f4f76b131d8dbf15c8dc4613a1405b75243914d7e10c2f9c01aef411ca9260a"} May 31 17:26:06.486360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:06.486341 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" event={"ID":"bc802361-95fa-44b0-bae4-3c943c759bda","Type":"ContainerStarted","Data":"872f49bdee68108f32a5252d028e306827e8965898bbeb1e51a0d57d865adeb5"} May 31 17:26:06.506217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:06.506149 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-d7849d7f7-9n294" podStartSLOduration=33.506137188 podStartE2EDuration="33.506137188s" podCreationTimestamp="2026-05-31 17:25:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:26:06.504980695 +0000 UTC m=+176.101334239" watchObservedRunningTime="2026-05-31 17:26:06.506137188 +0000 UTC m=+176.102490729" May 31 17:26:06.608997 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:06.608966 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:06.611755 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:06.611727 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:07.489518 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:07.489486 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:07.490895 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:07.490870 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d7849d7f7-9n294" May 31 17:26:08.493262 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:08.493225 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" event={"ID":"bc802361-95fa-44b0-bae4-3c943c759bda","Type":"ContainerStarted","Data":"4c08a8c0b93e4d3acc9e82664fbc0d22332a7eeb6d81ef38e065daa4756cccf6"} May 31 17:26:08.511715 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:08.511667 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mvgj4" podStartSLOduration=33.639089596 podStartE2EDuration="35.511653511s" podCreationTimestamp="2026-05-31 17:25:33 +0000 UTC" firstStartedPulling="2026-05-31 17:26:05.752132725 +0000 UTC m=+175.348486245" lastFinishedPulling="2026-05-31 17:26:07.624696628 +0000 UTC m=+177.221050160" observedRunningTime="2026-05-31 17:26:08.511096354 +0000 UTC m=+178.107449896" watchObservedRunningTime="2026-05-31 17:26:08.511653511 +0000 UTC m=+178.108007052" May 31 17:26:10.870809 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:10.870779 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-795fb89dd6-xcv8t"] May 31 17:26:20.549965 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.549916 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-d8d8f"] May 31 17:26:20.554935 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.554901 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.557563 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.557537 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 31 17:26:20.557654 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.557634 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jlhmb\"" May 31 17:26:20.557714 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.557640 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 31 17:26:20.557768 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.557733 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 31 17:26:20.565799 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.565777 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-d8d8f"] May 31 17:26:20.592283 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.592259 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gzrdp"] May 31 17:26:20.595192 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.595178 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.597757 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.597739 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 31 17:26:20.597757 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.597751 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 31 17:26:20.597905 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.597789 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 31 17:26:20.597905 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.597853 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9m29w\"" May 31 17:26:20.673814 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.673786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.673827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7356c610-4be9-4604-92f0-7421cf141406-metrics-client-ca\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.673870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-tls\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.673914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.674040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.673965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-wtmp\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvt9c\" (UniqueName: \"kubernetes.io/projected/9cf79f85-dde8-4191-b11b-4c5314c64aaf-kube-api-access-jvt9c\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.674271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf79f85-dde8-4191-b11b-4c5314c64aaf-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.674271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-textfile\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.674271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-sys\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-root\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.674271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.674217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfn9\" (UniqueName: \"kubernetes.io/projected/7356c610-4be9-4604-92f0-7421cf141406-kube-api-access-5dfn9\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.775419 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775386 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.775419 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775423 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7356c610-4be9-4604-92f0-7421cf141406-metrics-client-ca\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.775598 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775459 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-tls\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.775598 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775565 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.775700 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775597 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-wtmp\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.775700 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775639 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.775700 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775661 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvt9c\" (UniqueName: \"kubernetes.io/projected/9cf79f85-dde8-4191-b11b-4c5314c64aaf-kube-api-access-jvt9c\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.775700 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775698 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf79f85-dde8-4191-b11b-4c5314c64aaf-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.775897 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:20.775714 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 31 17:26:20.776097 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:20.776073 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-tls podName:9cf79f85-dde8-4191-b11b-4c5314c64aaf nodeName:}" failed. No retries permitted until 2026-05-31 17:26:21.276053415 +0000 UTC m=+190.872406946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-d8d8f" (UID: "9cf79f85-dde8-4191-b11b-4c5314c64aaf") : secret "openshift-state-metrics-tls" not found May 31 17:26:20.776097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-wtmp\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776087 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7356c610-4be9-4604-92f0-7421cf141406-metrics-client-ca\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-textfile\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776097 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.775731 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-textfile\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776189 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-sys\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776216 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-root\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776245 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfn9\" (UniqueName: \"kubernetes.io/projected/7356c610-4be9-4604-92f0-7421cf141406-kube-api-access-5dfn9\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776350 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-sys\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7356c610-4be9-4604-92f0-7421cf141406-root\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776407 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.776712 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.776484 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf79f85-dde8-4191-b11b-4c5314c64aaf-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.778504 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.778483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.778585 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.778521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.778641 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.778598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7356c610-4be9-4604-92f0-7421cf141406-node-exporter-tls\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.784304 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.784261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfn9\" (UniqueName: \"kubernetes.io/projected/7356c610-4be9-4604-92f0-7421cf141406-kube-api-access-5dfn9\") pod \"node-exporter-gzrdp\" (UID: \"7356c610-4be9-4604-92f0-7421cf141406\") " pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.784401 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.784272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvt9c\" (UniqueName: \"kubernetes.io/projected/9cf79f85-dde8-4191-b11b-4c5314c64aaf-kube-api-access-jvt9c\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:20.875794 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.875725 2567 patch_prober.go:28] interesting pod/image-registry-795fb89dd6-xcv8t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:20.875794 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.875771 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:20.903711 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:20.903688 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzrdp" May 31 17:26:20.911304 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:20.911280 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7356c610_4be9_4604_92f0_7421cf141406.slice/crio-f7e94635a17c91e06bf6fa4d69118ba38be5c37d140535e792a218ebbb898b75 WatchSource:0}: Error finding container f7e94635a17c91e06bf6fa4d69118ba38be5c37d140535e792a218ebbb898b75: Status 404 returned error can't find the container with id f7e94635a17c91e06bf6fa4d69118ba38be5c37d140535e792a218ebbb898b75 May 31 17:26:21.279210 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:21.279140 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:21.281595 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:21.281564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf79f85-dde8-4191-b11b-4c5314c64aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-d8d8f\" (UID: \"9cf79f85-dde8-4191-b11b-4c5314c64aaf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:21.463685 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:21.463655 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" May 31 17:26:21.531042 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:21.530948 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzrdp" event={"ID":"7356c610-4be9-4604-92f0-7421cf141406","Type":"ContainerStarted","Data":"f7e94635a17c91e06bf6fa4d69118ba38be5c37d140535e792a218ebbb898b75"} May 31 17:26:21.618098 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:21.618063 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-d8d8f"] May 31 17:26:22.537516 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:22.537476 2567 generic.go:358] "Generic (PLEG): container finished" podID="7356c610-4be9-4604-92f0-7421cf141406" containerID="8bad5a56db67c18da5b610e7ab57005f6e27fd1acfda2308b5e429f000509f0b" exitCode=0 May 31 17:26:22.537699 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:22.537570 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzrdp" event={"ID":"7356c610-4be9-4604-92f0-7421cf141406","Type":"ContainerDied","Data":"8bad5a56db67c18da5b610e7ab57005f6e27fd1acfda2308b5e429f000509f0b"} May 31 17:26:22.539477 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:22.539446 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" event={"ID":"9cf79f85-dde8-4191-b11b-4c5314c64aaf","Type":"ContainerStarted","Data":"f79d9772ca8d3496761826b9e74fce9379d0a7a0902b378406d17db505016028"} May 31 17:26:22.539616 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:22.539486 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" event={"ID":"9cf79f85-dde8-4191-b11b-4c5314c64aaf","Type":"ContainerStarted","Data":"1bc01c54730a1cc105fe2bfcd55753c50f92041059a6354e0fc0f889af09e248"} May 31 17:26:22.539616 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:22.539502 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" event={"ID":"9cf79f85-dde8-4191-b11b-4c5314c64aaf","Type":"ContainerStarted","Data":"925a57bf17dad13d44951f4aa70f01ed7b06b369eb53a165f59235cb139132bb"} May 31 17:26:23.543313 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.543277 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzrdp" event={"ID":"7356c610-4be9-4604-92f0-7421cf141406","Type":"ContainerStarted","Data":"6e4dfeeefb1306b381a79367ededff949cb792bc664c5266471d6e6ea3cf6b22"} May 31 17:26:23.543313 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.543317 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzrdp" event={"ID":"7356c610-4be9-4604-92f0-7421cf141406","Type":"ContainerStarted","Data":"4ae7f9afd8c2aa15ceb1b2c82d6965f5ae34c23407bfbd94e267786793f72d11"} May 31 17:26:23.545288 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.545262 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5"] May 31 17:26:23.547532 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.547506 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" event={"ID":"9cf79f85-dde8-4191-b11b-4c5314c64aaf","Type":"ContainerStarted","Data":"9e4392c8f56d97fe0295895d90bb8d5e0fc3a4a049189986148554353cdd82c4"} May 31 17:26:23.547644 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.547620 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.550145 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550124 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 31 17:26:23.550270 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550163 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 31 17:26:23.550270 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550259 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 31 17:26:23.550372 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550356 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5obsetpr9okp6\"" May 31 17:26:23.550415 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550387 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nd2k4\"" May 31 17:26:23.550415 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550384 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 31 17:26:23.550494 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.550418 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 31 17:26:23.559826 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.559805 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5"] May 31 17:26:23.565224 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.565175 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gzrdp" podStartSLOduration=2.531995528 podStartE2EDuration="3.565160533s" podCreationTimestamp="2026-05-31 17:26:20 +0000 UTC" firstStartedPulling="2026-05-31 17:26:20.913197961 +0000 UTC m=+190.509551480" lastFinishedPulling="2026-05-31 17:26:21.946362954 +0000 UTC m=+191.542716485" observedRunningTime="2026-05-31 17:26:23.564377944 +0000 UTC m=+193.160731486" watchObservedRunningTime="2026-05-31 17:26:23.565160533 +0000 UTC m=+193.161514075" May 31 17:26:23.598805 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.598739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.598805 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.598783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.599027 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.599007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.599127 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.599106 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-tls\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.599192 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.599152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdfd\" (UniqueName: \"kubernetes.io/projected/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-kube-api-access-nzdfd\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.599248 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.599207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.599381 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.599369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-grpc-tls\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.599433 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.599395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-metrics-client-ca\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.600626 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.600592 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-d8d8f" podStartSLOduration=2.229076122 podStartE2EDuration="3.600582788s" podCreationTimestamp="2026-05-31 17:26:20 +0000 UTC" firstStartedPulling="2026-05-31 17:26:21.956166912 +0000 UTC m=+191.552520436" lastFinishedPulling="2026-05-31 17:26:23.32767357 +0000 UTC m=+192.924027102" observedRunningTime="2026-05-31 17:26:23.600185671 +0000 UTC m=+193.196539212" watchObservedRunningTime="2026-05-31 17:26:23.600582788 +0000 UTC m=+193.196936326" May 31 17:26:23.700025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700001 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-metrics-client-ca\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700122 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700037 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700122 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700059 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700122 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700094 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700229 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700132 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-tls\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700229 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700154 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdfd\" (UniqueName: \"kubernetes.io/projected/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-kube-api-access-nzdfd\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700432 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700308 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700432 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700392 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-grpc-tls\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.700784 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.700743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-metrics-client-ca\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.702901 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.702876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.702901 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.702892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-tls\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.703214 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.703197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.703288 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.703267 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.703365 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.703344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.703519 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.703505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-secret-grpc-tls\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.707633 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.707612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdfd\" (UniqueName: \"kubernetes.io/projected/02ec8d0a-3024-4e78-ad29-ebedd8f1d001-kube-api-access-nzdfd\") pod \"thanos-querier-6c646bdbdc-p9hl5\" (UID: \"02ec8d0a-3024-4e78-ad29-ebedd8f1d001\") " pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.857146 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.857097 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:23.982678 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:23.982651 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5"] May 31 17:26:23.985751 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:23.985724 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ec8d0a_3024_4e78_ad29_ebedd8f1d001.slice/crio-9de90853a7da5161669062aaa5195f95a4d08e1edf4269358098ccae80706ab9 WatchSource:0}: Error finding container 9de90853a7da5161669062aaa5195f95a4d08e1edf4269358098ccae80706ab9: Status 404 returned error can't find the container with id 9de90853a7da5161669062aaa5195f95a4d08e1edf4269358098ccae80706ab9 May 31 17:26:24.549910 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.549877 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"9de90853a7da5161669062aaa5195f95a4d08e1edf4269358098ccae80706ab9"} May 31 17:26:24.807602 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.807517 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-cn5gl"] May 31 17:26:24.810369 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.810343 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:24.812764 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.812742 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-f9227\"" May 31 17:26:24.812883 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.812793 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 31 17:26:24.812883 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.812796 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 31 17:26:24.820697 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.820677 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-cn5gl"] May 31 17:26:24.912209 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.912168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkgw\" (UniqueName: \"kubernetes.io/projected/d17b224f-b9fd-48eb-a90b-07bd52898ec7-kube-api-access-qhkgw\") pod \"downloads-c65b8dc4b-cn5gl\" (UID: \"d17b224f-b9fd-48eb-a90b-07bd52898ec7\") " pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:24.969287 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.969254 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5785d498d5-2zbg9"] May 31 17:26:24.971538 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.971515 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:24.974224 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.974206 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-grlch\"" May 31 17:26:24.974504 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.974481 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 31 17:26:24.974692 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.974674 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 31 17:26:24.975809 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.975605 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 31 17:26:24.975809 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.975628 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5c6q5dd463ikb\"" May 31 17:26:24.975809 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.975666 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 31 17:26:24.983597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:24.983573 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5785d498d5-2zbg9"] May 31 17:26:25.013479 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2f574-d0dc-4a90-aaec-747bb2028449-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.013592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013487 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkgw\" (UniqueName: \"kubernetes.io/projected/d17b224f-b9fd-48eb-a90b-07bd52898ec7-kube-api-access-qhkgw\") pod \"downloads-c65b8dc4b-cn5gl\" (UID: \"d17b224f-b9fd-48eb-a90b-07bd52898ec7\") " pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:25.013592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-secret-metrics-server-tls\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.013592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27f2f574-d0dc-4a90-aaec-747bb2028449-metrics-server-audit-profiles\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.013747 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27f2f574-d0dc-4a90-aaec-747bb2028449-audit-log\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.013747 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-client-ca-bundle\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.013850 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-secret-metrics-server-client-certs\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.013850 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.013803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6vnb\" (UniqueName: \"kubernetes.io/projected/27f2f574-d0dc-4a90-aaec-747bb2028449-kube-api-access-d6vnb\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.023849 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.023820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkgw\" (UniqueName: \"kubernetes.io/projected/d17b224f-b9fd-48eb-a90b-07bd52898ec7-kube-api-access-qhkgw\") pod \"downloads-c65b8dc4b-cn5gl\" (UID: \"d17b224f-b9fd-48eb-a90b-07bd52898ec7\") " pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:25.114367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114305 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-secret-metrics-server-tls\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114336 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27f2f574-d0dc-4a90-aaec-747bb2028449-metrics-server-audit-profiles\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114549 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114368 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27f2f574-d0dc-4a90-aaec-747bb2028449-audit-log\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114599 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114551 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-client-ca-bundle\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114645 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114589 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-secret-metrics-server-client-certs\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114645 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114625 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vnb\" (UniqueName: \"kubernetes.io/projected/27f2f574-d0dc-4a90-aaec-747bb2028449-kube-api-access-d6vnb\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114742 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114668 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2f574-d0dc-4a90-aaec-747bb2028449-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.114796 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.114740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27f2f574-d0dc-4a90-aaec-747bb2028449-audit-log\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.115732 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.115702 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27f2f574-d0dc-4a90-aaec-747bb2028449-metrics-server-audit-profiles\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.115844 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.115809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2f574-d0dc-4a90-aaec-747bb2028449-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.117274 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.117249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-secret-metrics-server-tls\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.117456 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.117433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-client-ca-bundle\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.117943 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.117903 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27f2f574-d0dc-4a90-aaec-747bb2028449-secret-metrics-server-client-certs\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.121252 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.121203 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:25.123748 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.123726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6vnb\" (UniqueName: \"kubernetes.io/projected/27f2f574-d0dc-4a90-aaec-747bb2028449-kube-api-access-d6vnb\") pod \"metrics-server-5785d498d5-2zbg9\" (UID: \"27f2f574-d0dc-4a90-aaec-747bb2028449\") " pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.256888 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.256781 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-cn5gl"] May 31 17:26:25.259398 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:25.259371 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17b224f_b9fd_48eb_a90b_07bd52898ec7.slice/crio-185309d530b27f5ef6b2d415c9edbe7e725f7c73e85686c48b393b89d7d7e544 WatchSource:0}: Error finding container 185309d530b27f5ef6b2d415c9edbe7e725f7c73e85686c48b393b89d7d7e544: Status 404 returned error can't find the container with id 185309d530b27f5ef6b2d415c9edbe7e725f7c73e85686c48b393b89d7d7e544 May 31 17:26:25.282505 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.282479 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:25.345318 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.345286 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft"] May 31 17:26:25.349688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.349666 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:25.352227 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.352207 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 31 17:26:25.352320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.352252 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-dz5h4\"" May 31 17:26:25.356543 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.356522 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft"] May 31 17:26:25.414973 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.414949 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5785d498d5-2zbg9"] May 31 17:26:25.417009 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.416984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-2q4ft\" (UID: \"9ec0dfb8-e514-4c89-a3a4-a91287486e46\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:25.417320 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:25.417297 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f2f574_d0dc_4a90_aaec_747bb2028449.slice/crio-080bc5c1f1e9034b40d8fa70a40f409ea820a1916a7c5cbebf6d72b3c0862c1e WatchSource:0}: Error finding container 080bc5c1f1e9034b40d8fa70a40f409ea820a1916a7c5cbebf6d72b3c0862c1e: Status 404 returned error can't find the container with id 080bc5c1f1e9034b40d8fa70a40f409ea820a1916a7c5cbebf6d72b3c0862c1e May 31 17:26:25.518083 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.518057 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-2q4ft\" (UID: \"9ec0dfb8-e514-4c89-a3a4-a91287486e46\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:25.518166 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:25.518159 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 31 17:26:25.518210 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:25.518206 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert podName:9ec0dfb8-e514-4c89-a3a4-a91287486e46 nodeName:}" failed. No retries permitted until 2026-05-31 17:26:26.018191765 +0000 UTC m=+195.614545283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-2q4ft" (UID: "9ec0dfb8-e514-4c89-a3a4-a91287486e46") : secret "monitoring-plugin-cert" not found May 31 17:26:25.553701 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.553673 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" event={"ID":"27f2f574-d0dc-4a90-aaec-747bb2028449","Type":"ContainerStarted","Data":"080bc5c1f1e9034b40d8fa70a40f409ea820a1916a7c5cbebf6d72b3c0862c1e"} May 31 17:26:25.554942 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:25.554893 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-cn5gl" event={"ID":"d17b224f-b9fd-48eb-a90b-07bd52898ec7","Type":"ContainerStarted","Data":"185309d530b27f5ef6b2d415c9edbe7e725f7c73e85686c48b393b89d7d7e544"} May 31 17:26:26.022990 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:26.022954 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-2q4ft\" (UID: \"9ec0dfb8-e514-4c89-a3a4-a91287486e46\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:26.023250 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:26.023091 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 31 17:26:26.023250 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:26.023157 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert podName:9ec0dfb8-e514-4c89-a3a4-a91287486e46 nodeName:}" failed. No retries permitted until 2026-05-31 17:26:27.02314058 +0000 UTC m=+196.619494099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-2q4ft" (UID: "9ec0dfb8-e514-4c89-a3a4-a91287486e46") : secret "monitoring-plugin-cert" not found May 31 17:26:26.560572 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:26.560491 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"75cfdffc8c6ba8aaee81cea99b54796beabc275bbc0e58a06f05de04f1446e6b"} May 31 17:26:26.560572 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:26.560533 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"54cbf549ca1703edd222c7d6c42f379b35ca7a1b9a53953fd64304796cb233fd"} May 31 17:26:26.560572 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:26.560546 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"b717f4cb97a22cb57ddbb919cf423c05fe51001d4d667d469d47ddc8f73789be"} May 31 17:26:27.032102 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:27.032025 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-2q4ft\" (UID: \"9ec0dfb8-e514-4c89-a3a4-a91287486e46\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:27.034999 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:27.034971 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ec0dfb8-e514-4c89-a3a4-a91287486e46-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-2q4ft\" (UID: \"9ec0dfb8-e514-4c89-a3a4-a91287486e46\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:27.162112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:27.162080 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:27.689481 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:27.689453 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft"] May 31 17:26:27.693766 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:27.693735 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec0dfb8_e514_4c89_a3a4_a91287486e46.slice/crio-2d0d83275c12f9d86527d1d9b5ef1c2c0573c0285ffd4f0bc953c1e5461db6d6 WatchSource:0}: Error finding container 2d0d83275c12f9d86527d1d9b5ef1c2c0573c0285ffd4f0bc953c1e5461db6d6: Status 404 returned error can't find the container with id 2d0d83275c12f9d86527d1d9b5ef1c2c0573c0285ffd4f0bc953c1e5461db6d6 May 31 17:26:28.570697 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.570658 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"c24736786ac5e8849929bdf30f9c4e8e22c87f1f807b207977b3c08a0a1f088e"} May 31 17:26:28.570894 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.570704 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"2cd337f0b8b2fa978bbc5f58b6e87c2020b1773b1edafb4e4c23c111177788d6"} May 31 17:26:28.570894 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.570718 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" event={"ID":"02ec8d0a-3024-4e78-ad29-ebedd8f1d001","Type":"ContainerStarted","Data":"6ccae5da7d9efa8d8cd410a44876a4a5233331a335a1576f3935079f3f389c8d"} May 31 17:26:28.571069 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.570908 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:28.572603 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.572571 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" event={"ID":"27f2f574-d0dc-4a90-aaec-747bb2028449","Type":"ContainerStarted","Data":"fe44e04bac976d3250b6a283772e904ca22fa7962a68f2fbce8c388a0d85b3b5"} May 31 17:26:28.573960 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.573906 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" event={"ID":"9ec0dfb8-e514-4c89-a3a4-a91287486e46","Type":"ContainerStarted","Data":"2d0d83275c12f9d86527d1d9b5ef1c2c0573c0285ffd4f0bc953c1e5461db6d6"} May 31 17:26:28.599540 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.599494 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" podStartSLOduration=2.0394061470000002 podStartE2EDuration="5.599482972s" podCreationTimestamp="2026-05-31 17:26:23 +0000 UTC" firstStartedPulling="2026-05-31 17:26:23.987518927 +0000 UTC m=+193.583872446" lastFinishedPulling="2026-05-31 17:26:27.547595748 +0000 UTC m=+197.143949271" observedRunningTime="2026-05-31 17:26:28.59888106 +0000 UTC m=+198.195234614" watchObservedRunningTime="2026-05-31 17:26:28.599482972 +0000 UTC m=+198.195836551" May 31 17:26:28.620447 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:28.620397 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" podStartSLOduration=2.4949168999999998 podStartE2EDuration="4.620380959s" podCreationTimestamp="2026-05-31 17:26:24 +0000 UTC" firstStartedPulling="2026-05-31 17:26:25.419132885 +0000 UTC m=+195.015486403" lastFinishedPulling="2026-05-31 17:26:27.544596929 +0000 UTC m=+197.140950462" observedRunningTime="2026-05-31 17:26:28.620077909 +0000 UTC m=+198.216431451" watchObservedRunningTime="2026-05-31 17:26:28.620380959 +0000 UTC m=+198.216734504" May 31 17:26:29.578308 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:29.578222 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" event={"ID":"9ec0dfb8-e514-4c89-a3a4-a91287486e46","Type":"ContainerStarted","Data":"904e23b80cb4a4851c7bbc86963bf4b512df91582749b5da0c9f31ff832ede61"} May 31 17:26:29.593961 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:29.593895 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" podStartSLOduration=2.965480507 podStartE2EDuration="4.59388175s" podCreationTimestamp="2026-05-31 17:26:25 +0000 UTC" firstStartedPulling="2026-05-31 17:26:27.695986519 +0000 UTC m=+197.292340052" lastFinishedPulling="2026-05-31 17:26:29.324387775 +0000 UTC m=+198.920741295" observedRunningTime="2026-05-31 17:26:29.593597806 +0000 UTC m=+199.189951339" watchObservedRunningTime="2026-05-31 17:26:29.59388175 +0000 UTC m=+199.190235346" May 31 17:26:30.581439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:30.581407 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:30.587074 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:30.587042 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-2q4ft" May 31 17:26:30.876360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:30.876275 2567 patch_prober.go:28] interesting pod/image-registry-795fb89dd6-xcv8t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 31 17:26:30.876360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:30.876324 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 31 17:26:34.586483 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.586455 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c646bdbdc-p9hl5" May 31 17:26:34.915868 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.915772 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc9477688-fslkr"] May 31 17:26:34.920141 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.920112 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:34.923290 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.923187 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 31 17:26:34.923290 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.923187 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 31 17:26:34.923290 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.923239 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 31 17:26:34.923597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.923189 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ccttn\"" May 31 17:26:34.923597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.923240 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 31 17:26:34.923597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.923189 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 31 17:26:34.928604 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:34.928274 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc9477688-fslkr"] May 31 17:26:35.000867 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.000818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv7k5\" (UniqueName: \"kubernetes.io/projected/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-kube-api-access-dv7k5\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.001024 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.000879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-serving-cert\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.001024 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.000988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-service-ca\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.001024 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.001018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-config\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.001166 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.001048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-oauth-config\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.001166 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.001096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-oauth-serving-cert\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.101745 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.101712 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv7k5\" (UniqueName: \"kubernetes.io/projected/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-kube-api-access-dv7k5\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.101947 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.101758 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-serving-cert\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.101947 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.101824 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-service-ca\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.101947 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.101849 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-config\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.101947 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.101889 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-oauth-config\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.102285 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.101961 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-oauth-serving-cert\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.102665 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.102638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-config\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.102939 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.102638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-oauth-serving-cert\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.102939 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.102840 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-service-ca\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.104546 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.104519 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-serving-cert\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.104968 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.104945 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-oauth-config\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.110113 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.110089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv7k5\" (UniqueName: \"kubernetes.io/projected/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-kube-api-access-dv7k5\") pod \"console-6dc9477688-fslkr\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.232460 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.232373 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:35.890217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:35.890150 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" containerID="cri-o://10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d" gracePeriod=30 May 31 17:26:40.872155 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:40.872115 2567 patch_prober.go:28] interesting pod/image-registry-795fb89dd6-xcv8t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.133.0.11:5000/healthz\": dial tcp 10.133.0.11:5000: connect: connection refused" start-of-body= May 31 17:26:40.872574 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:40.872177 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" probeResult="failure" output="Get \"https://10.133.0.11:5000/healthz\": dial tcp 10.133.0.11:5000: connect: connection refused" May 31 17:26:41.935837 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:41.935802 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc9477688-fslkr"] May 31 17:26:41.938344 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:26:41.938315 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4a3cc3_5e77_4aa1_ac2e_8342d71a4008.slice/crio-59e50d0d59735dc1b6dd0055b4b6637cc5f6501ab8d399b134156e087ca145e1 WatchSource:0}: Error finding container 59e50d0d59735dc1b6dd0055b4b6637cc5f6501ab8d399b134156e087ca145e1: Status 404 returned error can't find the container with id 59e50d0d59735dc1b6dd0055b4b6637cc5f6501ab8d399b134156e087ca145e1 May 31 17:26:41.951836 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:41.951818 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:26:42.064499 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064473 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-trusted-ca\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064624 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064520 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-certificates\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064624 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064548 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-installation-pull-secrets\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064624 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064602 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-bound-sa-token\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064769 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064641 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/062d0507-7703-41b9-9c48-09d3a3b25d37-ca-trust-extracted\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064822 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064780 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94c7h\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-kube-api-access-94c7h\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064881 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064853 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.064954 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.064895 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-image-registry-private-configuration\") pod \"062d0507-7703-41b9-9c48-09d3a3b25d37\" (UID: \"062d0507-7703-41b9-9c48-09d3a3b25d37\") " May 31 17:26:42.065091 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.065063 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:26:42.065174 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.065080 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:26:42.065255 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.065235 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-trusted-ca\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.065310 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.065266 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-certificates\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.067137 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.067111 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:26:42.067533 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.067512 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:26:42.067682 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.067659 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-kube-api-access-94c7h" (OuterVolumeSpecName: "kube-api-access-94c7h") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "kube-api-access-94c7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:26:42.067746 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.067663 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:26:42.067835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.067813 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:26:42.075333 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.075311 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/062d0507-7703-41b9-9c48-09d3a3b25d37-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "062d0507-7703-41b9-9c48-09d3a3b25d37" (UID: "062d0507-7703-41b9-9c48-09d3a3b25d37"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:26:42.166154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.166122 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-installation-pull-secrets\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.166154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.166156 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-bound-sa-token\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.166350 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.166172 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/062d0507-7703-41b9-9c48-09d3a3b25d37-ca-trust-extracted\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.166350 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.166188 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94c7h\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-kube-api-access-94c7h\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.166350 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.166200 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/062d0507-7703-41b9-9c48-09d3a3b25d37-registry-tls\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.166350 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.166213 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/062d0507-7703-41b9-9c48-09d3a3b25d37-image-registry-private-configuration\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:26:42.616756 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.616655 2567 generic.go:358] "Generic (PLEG): container finished" podID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerID="10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d" exitCode=0 May 31 17:26:42.617154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.617116 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" event={"ID":"062d0507-7703-41b9-9c48-09d3a3b25d37","Type":"ContainerDied","Data":"10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d"} May 31 17:26:42.617154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.617164 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" event={"ID":"062d0507-7703-41b9-9c48-09d3a3b25d37","Type":"ContainerDied","Data":"718e53c1d51f54271ba90449f8678b280ad51e9fd967d0901397cbc214da4186"} May 31 17:26:42.617154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.617185 2567 scope.go:117] "RemoveContainer" containerID="10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d" May 31 17:26:42.617544 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.617349 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795fb89dd6-xcv8t" May 31 17:26:42.622153 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.622095 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc9477688-fslkr" event={"ID":"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008","Type":"ContainerStarted","Data":"59e50d0d59735dc1b6dd0055b4b6637cc5f6501ab8d399b134156e087ca145e1"} May 31 17:26:42.625755 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.625725 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-cn5gl" event={"ID":"d17b224f-b9fd-48eb-a90b-07bd52898ec7","Type":"ContainerStarted","Data":"730c934273a21648c1ee3b771d1c8d80befd041761f5dd2115311ea87d24d7e9"} May 31 17:26:42.626491 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.626469 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:42.630819 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.630795 2567 scope.go:117] "RemoveContainer" containerID="10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d" May 31 17:26:42.631128 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:26:42.631096 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d\": container with ID starting with 10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d not found: ID does not exist" containerID="10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d" May 31 17:26:42.631226 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.631139 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d"} err="failed to get container status \"10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d\": rpc error: code = NotFound desc = could not find container \"10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d\": container with ID starting with 10bcef6022e6fcd639ebfbd0a0407619148c1667e7301c1ffc5e9bfaaaab0d7d not found: ID does not exist" May 31 17:26:42.638446 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.638413 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-cn5gl" May 31 17:26:42.668468 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.668415 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-795fb89dd6-xcv8t"] May 31 17:26:42.669838 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.669814 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-795fb89dd6-xcv8t"] May 31 17:26:42.716118 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.714652 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-cn5gl" podStartSLOduration=2.088113002 podStartE2EDuration="18.714634181s" podCreationTimestamp="2026-05-31 17:26:24 +0000 UTC" firstStartedPulling="2026-05-31 17:26:25.261525036 +0000 UTC m=+194.857878555" lastFinishedPulling="2026-05-31 17:26:41.888046194 +0000 UTC m=+211.484399734" observedRunningTime="2026-05-31 17:26:42.692710154 +0000 UTC m=+212.289063697" watchObservedRunningTime="2026-05-31 17:26:42.714634181 +0000 UTC m=+212.310987723" May 31 17:26:42.948652 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:42.948263 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" path="/var/lib/kubelet/pods/062d0507-7703-41b9-9c48-09d3a3b25d37/volumes" May 31 17:26:43.496242 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.496195 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c74dfcb66-284wv"] May 31 17:26:43.496620 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.496593 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" May 31 17:26:43.496620 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.496611 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" May 31 17:26:43.496787 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.496697 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="062d0507-7703-41b9-9c48-09d3a3b25d37" containerName="registry" May 31 17:26:43.502131 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.502110 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.510994 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.510968 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 31 17:26:43.517352 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.517328 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c74dfcb66-284wv"] May 31 17:26:43.581710 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.581668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-oauth-config\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.581998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.581747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbrm\" (UniqueName: \"kubernetes.io/projected/fa573285-9a51-4f77-94e0-1ff3d8c47786-kube-api-access-mjbrm\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.581998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.581814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-config\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.581998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.581877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-service-ca\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.581998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.581902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-trusted-ca-bundle\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.581998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.581991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-oauth-serving-cert\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.582255 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.582028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-serving-cert\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683013 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.682979 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-serving-cert\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683191 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.683045 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-oauth-config\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683191 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.683091 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbrm\" (UniqueName: \"kubernetes.io/projected/fa573285-9a51-4f77-94e0-1ff3d8c47786-kube-api-access-mjbrm\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683191 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.683149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-config\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683191 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.683183 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-service-ca\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.683207 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-trusted-ca-bundle\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.683407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.683257 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-oauth-serving-cert\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.684180 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.684146 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-oauth-serving-cert\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.684661 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.684633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-config\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.685380 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.685352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-trusted-ca-bundle\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.686064 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.686041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-serving-cert\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.686173 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.686119 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-oauth-config\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.686759 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.686735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-service-ca\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.691685 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.691664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbrm\" (UniqueName: \"kubernetes.io/projected/fa573285-9a51-4f77-94e0-1ff3d8c47786-kube-api-access-mjbrm\") pod \"console-6c74dfcb66-284wv\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:43.819448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:43.819275 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:44.017221 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:44.014772 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c74dfcb66-284wv"] May 31 17:26:44.636750 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:44.636708 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c74dfcb66-284wv" event={"ID":"fa573285-9a51-4f77-94e0-1ff3d8c47786","Type":"ContainerStarted","Data":"081f7576dd4199a671a4f1b5e26d46479dfd31cc0f5edb07032b496b7d8dcf12"} May 31 17:26:45.283176 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:45.283005 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:45.283176 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:45.283144 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:26:46.644680 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:46.644638 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc9477688-fslkr" event={"ID":"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008","Type":"ContainerStarted","Data":"b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b"} May 31 17:26:46.646379 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:46.646351 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c74dfcb66-284wv" event={"ID":"fa573285-9a51-4f77-94e0-1ff3d8c47786","Type":"ContainerStarted","Data":"8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0"} May 31 17:26:46.665263 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:46.665223 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6dc9477688-fslkr" podStartSLOduration=8.554194589 podStartE2EDuration="12.665210872s" podCreationTimestamp="2026-05-31 17:26:34 +0000 UTC" firstStartedPulling="2026-05-31 17:26:41.94043957 +0000 UTC m=+211.536793100" lastFinishedPulling="2026-05-31 17:26:46.051455861 +0000 UTC m=+215.647809383" observedRunningTime="2026-05-31 17:26:46.664965893 +0000 UTC m=+216.261319442" watchObservedRunningTime="2026-05-31 17:26:46.665210872 +0000 UTC m=+216.261564484" May 31 17:26:46.685196 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:46.685157 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c74dfcb66-284wv" podStartSLOduration=1.66191358 podStartE2EDuration="3.685145633s" podCreationTimestamp="2026-05-31 17:26:43 +0000 UTC" firstStartedPulling="2026-05-31 17:26:44.029130487 +0000 UTC m=+213.625484006" lastFinishedPulling="2026-05-31 17:26:46.052362524 +0000 UTC m=+215.648716059" observedRunningTime="2026-05-31 17:26:46.68422115 +0000 UTC m=+216.280574692" watchObservedRunningTime="2026-05-31 17:26:46.685145633 +0000 UTC m=+216.281499174" May 31 17:26:53.819445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:53.819414 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:53.819445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:53.819446 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:26:53.820594 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:53.820575 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:26:53.820655 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:53.820621 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:26:55.232672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:55.232636 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:55.232672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:55.232676 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc9477688-fslkr" May 31 17:26:55.233870 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:55.233847 2567 patch_prober.go:28] interesting pod/console-6dc9477688-fslkr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 31 17:26:55.233969 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:55.233905 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 31 17:26:56.571574 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:56.571520 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-mvgj4_bc802361-95fa-44b0-bae4-3c943c759bda/cluster-monitoring-operator/0.log" May 31 17:26:57.369824 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:57.369796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5785d498d5-2zbg9_27f2f574-d0dc-4a90-aaec-747bb2028449/metrics-server/0.log" May 31 17:26:57.569622 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:57.569558 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-2q4ft_9ec0dfb8-e514-4c89-a3a4-a91287486e46/monitoring-plugin/0.log" May 31 17:26:58.968936 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:58.968903 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzrdp_7356c610-4be9-4604-92f0-7421cf141406/init-textfile/0.log" May 31 17:26:59.170628 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:59.170601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzrdp_7356c610-4be9-4604-92f0-7421cf141406/node-exporter/0.log" May 31 17:26:59.370048 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:59.370017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzrdp_7356c610-4be9-4604-92f0-7421cf141406/kube-rbac-proxy/0.log" May 31 17:26:59.569883 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:59.569852 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-d8d8f_9cf79f85-dde8-4191-b11b-4c5314c64aaf/kube-rbac-proxy-main/0.log" May 31 17:26:59.769236 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:59.769162 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-d8d8f_9cf79f85-dde8-4191-b11b-4c5314c64aaf/kube-rbac-proxy-self/0.log" May 31 17:26:59.969054 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:26:59.969028 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-d8d8f_9cf79f85-dde8-4191-b11b-4c5314c64aaf/openshift-state-metrics/0.log" May 31 17:27:02.170480 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:02.170448 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/thanos-query/0.log" May 31 17:27:02.369852 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:02.369819 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy-web/0.log" May 31 17:27:02.569045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:02.569021 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy/0.log" May 31 17:27:02.769082 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:02.769056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/prom-label-proxy/0.log" May 31 17:27:02.969200 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:02.969126 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy-rules/0.log" May 31 17:27:03.169823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:03.169804 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy-metrics/0.log" May 31 17:27:03.819883 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:03.819850 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:27:03.820260 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:03.819911 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:27:03.969705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:03.969670 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c74dfcb66-284wv_fa573285-9a51-4f77-94e0-1ff3d8c47786/console/0.log" May 31 17:27:04.169662 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:04.169581 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc9477688-fslkr_2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008/console/0.log" May 31 17:27:04.370812 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:04.370788 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-cn5gl_d17b224f-b9fd-48eb-a90b-07bd52898ec7/download-server/0.log" May 31 17:27:05.233584 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:05.233552 2567 patch_prober.go:28] interesting pod/console-6dc9477688-fslkr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 31 17:27:05.233961 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:05.233602 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 31 17:27:05.288084 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:05.288058 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:27:05.293103 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:05.293078 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5785d498d5-2zbg9" May 31 17:27:05.969068 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:05.969044 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n56bh_2bbcf623-ebaf-4b6c-90ca-61040294570b/dns-node-resolver/0.log" May 31 17:27:07.170174 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:07.170148 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfqmk_6e837042-0ec8-42f1-b1d3-e0a8a598c6df/node-ca/0.log" May 31 17:27:07.369844 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:07.369819 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7849d7f7-9n294_92937b26-0004-46b5-ab90-bf4be66b2e79/router/0.log" May 31 17:27:13.819414 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:13.819383 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:27:13.819799 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:13.819434 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:27:15.233734 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:15.233699 2567 patch_prober.go:28] interesting pod/console-6dc9477688-fslkr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 31 17:27:15.234121 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:15.233748 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 31 17:27:22.687553 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:22.687520 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:27:22.690045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:22.690025 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4841495e-5e34-474b-bf38-40a32da540f9-metrics-certs\") pod \"network-metrics-daemon-jxzgt\" (UID: \"4841495e-5e34-474b-bf38-40a32da540f9\") " pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:27:22.745167 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:22.745141 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrg\"" May 31 17:27:22.752417 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:22.752394 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxzgt" May 31 17:27:22.874090 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:22.874070 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jxzgt"] May 31 17:27:22.876534 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:27:22.876508 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4841495e_5e34_474b_bf38_40a32da540f9.slice/crio-2c36f277d5fec411916def3543faa55bc500a73b2af95f3a1abf97b69ab98645 WatchSource:0}: Error finding container 2c36f277d5fec411916def3543faa55bc500a73b2af95f3a1abf97b69ab98645: Status 404 returned error can't find the container with id 2c36f277d5fec411916def3543faa55bc500a73b2af95f3a1abf97b69ab98645 May 31 17:27:23.748387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:23.748351 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxzgt" event={"ID":"4841495e-5e34-474b-bf38-40a32da540f9","Type":"ContainerStarted","Data":"2c36f277d5fec411916def3543faa55bc500a73b2af95f3a1abf97b69ab98645"} May 31 17:27:23.820223 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:23.820190 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:27:23.820413 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:23.820252 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:27:24.757566 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:24.757532 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxzgt" event={"ID":"4841495e-5e34-474b-bf38-40a32da540f9","Type":"ContainerStarted","Data":"cb207812692f9092f76d22a699d651ab68757a71d463b36b8367c063a720c7a7"} May 31 17:27:24.757566 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:24.757567 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxzgt" event={"ID":"4841495e-5e34-474b-bf38-40a32da540f9","Type":"ContainerStarted","Data":"25743a06651bf5f83b80b34a0183bd6828d4c55ba5051f09889ea45c58f16f6b"} May 31 17:27:24.774674 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:24.774635 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jxzgt" podStartSLOduration=252.396364923 podStartE2EDuration="4m13.774622823s" podCreationTimestamp="2026-05-31 17:23:11 +0000 UTC" firstStartedPulling="2026-05-31 17:27:22.878244224 +0000 UTC m=+252.474597744" lastFinishedPulling="2026-05-31 17:27:24.256502113 +0000 UTC m=+253.852855644" observedRunningTime="2026-05-31 17:27:24.77304566 +0000 UTC m=+254.369399200" watchObservedRunningTime="2026-05-31 17:27:24.774622823 +0000 UTC m=+254.370976364" May 31 17:27:25.233272 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:25.233239 2567 patch_prober.go:28] interesting pod/console-6dc9477688-fslkr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 31 17:27:25.233423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:25.233290 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 31 17:27:33.820320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:33.820241 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:27:33.820742 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:33.820311 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:27:35.233477 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:35.233444 2567 patch_prober.go:28] interesting pod/console-6dc9477688-fslkr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 31 17:27:35.233852 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:35.233495 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 31 17:27:43.819580 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:43.819548 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:27:43.819980 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:43.819605 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:27:44.887106 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.887070 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf"] May 31 17:27:44.889693 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.889673 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.895912 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.892603 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 31 17:27:44.895912 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.893368 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 31 17:27:44.895912 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.893514 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 31 17:27:44.895912 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.893604 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 31 17:27:44.895912 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.894069 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lrznf\"" May 31 17:27:44.899250 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.899223 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 31 17:27:44.899403 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.899375 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 31 17:27:44.900666 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.900641 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf"] May 31 17:27:44.949471 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-metrics-client-ca\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2qfl\" (UniqueName: \"kubernetes.io/projected/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-kube-api-access-f2qfl\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-federate-client-tls\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949740 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-telemeter-client-tls\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949740 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-secret-telemeter-client\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:44.949740 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:44.949722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-serving-certs-ca-bundle\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.050739 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050710 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.050835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050750 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2qfl\" (UniqueName: \"kubernetes.io/projected/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-kube-api-access-f2qfl\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.050835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050774 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-federate-client-tls\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.050835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050795 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-telemeter-client-tls\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.050835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050828 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-secret-telemeter-client\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.051035 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050865 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-serving-certs-ca-bundle\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.051035 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050901 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-metrics-client-ca\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.051035 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.050950 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.051829 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.051803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-metrics-client-ca\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.052035 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.052008 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-serving-certs-ca-bundle\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.052168 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.052149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.053544 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.053522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-federate-client-tls\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.053662 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.053642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-telemeter-client-tls\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.054074 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.054053 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.054122 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.054060 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-secret-telemeter-client\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.059322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.059299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2qfl\" (UniqueName: \"kubernetes.io/projected/82f55b2e-0463-4c9a-9a01-cefd6a712c9b-kube-api-access-f2qfl\") pod \"telemeter-client-7f45d9c8c6-p8pzf\" (UID: \"82f55b2e-0463-4c9a-9a01-cefd6a712c9b\") " pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.205443 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.205392 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" May 31 17:27:45.233292 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.233267 2567 patch_prober.go:28] interesting pod/console-6dc9477688-fslkr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 31 17:27:45.233394 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.233322 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 31 17:27:45.336389 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.336362 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf"] May 31 17:27:45.338324 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:27:45.338296 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f55b2e_0463_4c9a_9a01_cefd6a712c9b.slice/crio-efbb4abb623b3165aaf4dfb34e539f65a4024f2754a07266a14fa252b4152bfd WatchSource:0}: Error finding container efbb4abb623b3165aaf4dfb34e539f65a4024f2754a07266a14fa252b4152bfd: Status 404 returned error can't find the container with id efbb4abb623b3165aaf4dfb34e539f65a4024f2754a07266a14fa252b4152bfd May 31 17:27:45.824354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:45.824322 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" event={"ID":"82f55b2e-0463-4c9a-9a01-cefd6a712c9b","Type":"ContainerStarted","Data":"efbb4abb623b3165aaf4dfb34e539f65a4024f2754a07266a14fa252b4152bfd"} May 31 17:27:47.832232 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:47.832199 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" event={"ID":"82f55b2e-0463-4c9a-9a01-cefd6a712c9b","Type":"ContainerStarted","Data":"cac2e3dd264467cc63e2c58c5d96d02e88f8f6398273476cbf7c8b23f56c93da"} May 31 17:27:48.841342 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:48.841306 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" event={"ID":"82f55b2e-0463-4c9a-9a01-cefd6a712c9b","Type":"ContainerStarted","Data":"0651a1a0ebbb1a004ff89ff1752346f62397205824eaa8c5d0d37e7f4c12267d"} May 31 17:27:48.841342 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:48.841348 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" event={"ID":"82f55b2e-0463-4c9a-9a01-cefd6a712c9b","Type":"ContainerStarted","Data":"696a5f5a16895d3b124808a08285a92425c770c7bee601e91faf3ebb7931bff6"} May 31 17:27:48.868612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:48.868564 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f45d9c8c6-p8pzf" podStartSLOduration=1.8339461350000001 podStartE2EDuration="4.868548834s" podCreationTimestamp="2026-05-31 17:27:44 +0000 UTC" firstStartedPulling="2026-05-31 17:27:45.34006674 +0000 UTC m=+274.936420258" lastFinishedPulling="2026-05-31 17:27:48.374669435 +0000 UTC m=+277.971022957" observedRunningTime="2026-05-31 17:27:48.864840446 +0000 UTC m=+278.461193986" watchObservedRunningTime="2026-05-31 17:27:48.868548834 +0000 UTC m=+278.464902375" May 31 17:27:48.961678 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:48.961655 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc9477688-fslkr"] May 31 17:27:49.006863 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.006840 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-747f565d86-zwbwm"] May 31 17:27:49.008848 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.008833 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.018119 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.018098 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747f565d86-zwbwm"] May 31 17:27:49.085980 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.085954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-trusted-ca-bundle\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.086074 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.085986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-oauth-config\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.086074 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.086064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-service-ca\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.086162 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.086091 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnmw\" (UniqueName: \"kubernetes.io/projected/ddce6a98-ad2c-452e-beb8-71a406cc59da-kube-api-access-zpnmw\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.086162 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.086114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-oauth-serving-cert\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.086162 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.086131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-config\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.086261 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.086179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-serving-cert\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187420 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187357 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-service-ca\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187420 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187398 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnmw\" (UniqueName: \"kubernetes.io/projected/ddce6a98-ad2c-452e-beb8-71a406cc59da-kube-api-access-zpnmw\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187431 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-oauth-serving-cert\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187456 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-config\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187485 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-serving-cert\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187522 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-trusted-ca-bundle\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.187716 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.187544 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-oauth-config\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.188235 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.188160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-oauth-serving-cert\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.188235 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.188181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-config\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.188235 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.188247 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-service-ca\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.188555 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.188364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-trusted-ca-bundle\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.189874 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.189853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-oauth-config\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.190147 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.190129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-serving-cert\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.196052 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.196031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnmw\" (UniqueName: \"kubernetes.io/projected/ddce6a98-ad2c-452e-beb8-71a406cc59da-kube-api-access-zpnmw\") pod \"console-747f565d86-zwbwm\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.318056 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.318035 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:49.444717 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.444480 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747f565d86-zwbwm"] May 31 17:27:49.447127 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:27:49.447098 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddce6a98_ad2c_452e_beb8_71a406cc59da.slice/crio-409c8557606870dee84d246650c1b40189691e1d55c64f01bc440bd30976f062 WatchSource:0}: Error finding container 409c8557606870dee84d246650c1b40189691e1d55c64f01bc440bd30976f062: Status 404 returned error can't find the container with id 409c8557606870dee84d246650c1b40189691e1d55c64f01bc440bd30976f062 May 31 17:27:49.847422 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.847388 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747f565d86-zwbwm" event={"ID":"ddce6a98-ad2c-452e-beb8-71a406cc59da","Type":"ContainerStarted","Data":"503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758"} May 31 17:27:49.847422 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.847424 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747f565d86-zwbwm" event={"ID":"ddce6a98-ad2c-452e-beb8-71a406cc59da","Type":"ContainerStarted","Data":"409c8557606870dee84d246650c1b40189691e1d55c64f01bc440bd30976f062"} May 31 17:27:49.865794 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:49.865700 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-747f565d86-zwbwm" podStartSLOduration=1.865684183 podStartE2EDuration="1.865684183s" podCreationTimestamp="2026-05-31 17:27:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:27:49.865308054 +0000 UTC m=+279.461661592" watchObservedRunningTime="2026-05-31 17:27:49.865684183 +0000 UTC m=+279.462037724" May 31 17:27:51.429124 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:27:51.429084 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wh4cq" podUID="255abd80-e011-4913-83ff-1c793ecbea8f" May 31 17:27:51.853356 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:51.853321 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh4cq" May 31 17:27:53.819954 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:53.819905 2567 patch_prober.go:28] interesting pod/console-6c74dfcb66-284wv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= May 31 17:27:53.820309 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:53.819977 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" May 31 17:27:54.829369 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.829336 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:27:54.829369 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.829372 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:27:54.831824 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.831803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/255abd80-e011-4913-83ff-1c793ecbea8f-metrics-tls\") pod \"dns-default-wh4cq\" (UID: \"255abd80-e011-4913-83ff-1c793ecbea8f\") " pod="openshift-dns/dns-default-wh4cq" May 31 17:27:54.831944 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.831859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b-cert\") pod \"ingress-canary-59rwv\" (UID: \"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b\") " pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:27:54.856284 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.856263 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-777ll\"" May 31 17:27:54.863960 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.863943 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wh4cq" May 31 17:27:54.985835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:54.985799 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wh4cq"] May 31 17:27:54.988365 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:27:54.988340 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255abd80_e011_4913_83ff_1c793ecbea8f.slice/crio-dd6016b0e5a70e19fcaf137d88eaae87ea35b0b3dee3f318731c96b8810de0a9 WatchSource:0}: Error finding container dd6016b0e5a70e19fcaf137d88eaae87ea35b0b3dee3f318731c96b8810de0a9: Status 404 returned error can't find the container with id dd6016b0e5a70e19fcaf137d88eaae87ea35b0b3dee3f318731c96b8810de0a9 May 31 17:27:55.046120 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:55.046097 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p8png\"" May 31 17:27:55.053482 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:55.053464 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59rwv" May 31 17:27:55.172752 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:55.172695 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59rwv"] May 31 17:27:55.175113 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:27:55.175082 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e7ffee_b2de_4a65_a9e2_5d5b05b3ec1b.slice/crio-b7b7d98d8758b7d78b6cb65079d5f03d15fa9406fcffa29f0e4e0cff51dee7a9 WatchSource:0}: Error finding container b7b7d98d8758b7d78b6cb65079d5f03d15fa9406fcffa29f0e4e0cff51dee7a9: Status 404 returned error can't find the container with id b7b7d98d8758b7d78b6cb65079d5f03d15fa9406fcffa29f0e4e0cff51dee7a9 May 31 17:27:55.864832 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:55.864784 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wh4cq" event={"ID":"255abd80-e011-4913-83ff-1c793ecbea8f","Type":"ContainerStarted","Data":"dd6016b0e5a70e19fcaf137d88eaae87ea35b0b3dee3f318731c96b8810de0a9"} May 31 17:27:55.866490 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:55.866442 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59rwv" event={"ID":"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b","Type":"ContainerStarted","Data":"b7b7d98d8758b7d78b6cb65079d5f03d15fa9406fcffa29f0e4e0cff51dee7a9"} May 31 17:27:56.871805 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:56.871756 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wh4cq" event={"ID":"255abd80-e011-4913-83ff-1c793ecbea8f","Type":"ContainerStarted","Data":"2545e226148d3c37113e3231a899c0ca340afef9ce4a62cfb7aed9481bc665d5"} May 31 17:27:56.873330 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:56.873287 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59rwv" event={"ID":"e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b","Type":"ContainerStarted","Data":"12d99bdb8170c83040ef7f9652ca5bdf0be34fcb0ca1e87466881c3da14db40e"} May 31 17:27:56.891995 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:56.891887 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-59rwv" podStartSLOduration=251.295736225 podStartE2EDuration="4m12.891871339s" podCreationTimestamp="2026-05-31 17:23:44 +0000 UTC" firstStartedPulling="2026-05-31 17:27:55.177008339 +0000 UTC m=+284.773361857" lastFinishedPulling="2026-05-31 17:27:56.773143449 +0000 UTC m=+286.369496971" observedRunningTime="2026-05-31 17:27:56.890896379 +0000 UTC m=+286.487249920" watchObservedRunningTime="2026-05-31 17:27:56.891871339 +0000 UTC m=+286.488224881" May 31 17:27:57.877976 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:57.877937 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wh4cq" event={"ID":"255abd80-e011-4913-83ff-1c793ecbea8f","Type":"ContainerStarted","Data":"0b8492bf7aa166ec23dd4120c588e05d26803b4d89129ebf888feac04eaf859e"} May 31 17:27:57.894638 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:57.894592 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-wh4cq" podStartSLOduration=252.114220933 podStartE2EDuration="4m13.894578389s" podCreationTimestamp="2026-05-31 17:23:44 +0000 UTC" firstStartedPulling="2026-05-31 17:27:54.990048574 +0000 UTC m=+284.586402094" lastFinishedPulling="2026-05-31 17:27:56.770405845 +0000 UTC m=+286.366759550" observedRunningTime="2026-05-31 17:27:57.893673673 +0000 UTC m=+287.490027216" watchObservedRunningTime="2026-05-31 17:27:57.894578389 +0000 UTC m=+287.490931955" May 31 17:27:58.881360 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:58.881331 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wh4cq" May 31 17:27:59.319061 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:59.319033 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:59.319209 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:59.319104 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:27:59.320303 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:59.320280 2567 patch_prober.go:28] interesting pod/console-747f565d86-zwbwm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= May 31 17:27:59.320405 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:27:59.320320 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-747f565d86-zwbwm" podUID="ddce6a98-ad2c-452e-beb8-71a406cc59da" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" May 31 17:28:03.823689 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:03.823655 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:28:03.827498 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:03.827481 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:28:08.885967 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:08.885912 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wh4cq" May 31 17:28:09.323262 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:09.323236 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:28:09.327986 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:09.327962 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:28:09.390154 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:09.390125 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c74dfcb66-284wv"] May 31 17:28:10.853139 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:10.853117 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:28:10.853594 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:10.853544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:28:10.856196 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:10.856179 2567 kubelet.go:1628] "Image garbage collection succeeded" May 31 17:28:13.981052 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:13.981018 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6dc9477688-fslkr" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" containerID="cri-o://b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b" gracePeriod=15 May 31 17:28:14.217447 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.217427 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc9477688-fslkr_2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008/console/0.log" May 31 17:28:14.217557 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.217483 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc9477688-fslkr" May 31 17:28:14.373778 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.373743 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-serving-cert\") pod \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " May 31 17:28:14.373940 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.373811 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-oauth-serving-cert\") pod \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " May 31 17:28:14.373940 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.373850 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv7k5\" (UniqueName: \"kubernetes.io/projected/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-kube-api-access-dv7k5\") pod \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " May 31 17:28:14.373940 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.373882 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-oauth-config\") pod \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " May 31 17:28:14.374084 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.374041 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-service-ca\") pod \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " May 31 17:28:14.374140 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.374096 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-config\") pod \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\" (UID: \"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008\") " May 31 17:28:14.374366 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.374341 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" (UID: "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:14.374477 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.374442 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-config" (OuterVolumeSpecName: "console-config") pod "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" (UID: "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:14.374477 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.374453 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" (UID: "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:14.376213 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.376194 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" (UID: "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:28:14.376300 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.376210 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-kube-api-access-dv7k5" (OuterVolumeSpecName: "kube-api-access-dv7k5") pod "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" (UID: "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008"). InnerVolumeSpecName "kube-api-access-dv7k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:28:14.376300 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.376283 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" (UID: "2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:28:14.474756 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.474732 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv7k5\" (UniqueName: \"kubernetes.io/projected/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-kube-api-access-dv7k5\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:14.474756 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.474752 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-oauth-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:14.474876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.474762 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-service-ca\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:14.474876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.474771 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:14.474876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.474779 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-console-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:14.474876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.474787 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008-oauth-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:14.932804 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.932779 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc9477688-fslkr_2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008/console/0.log" May 31 17:28:14.932957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.932816 2567 generic.go:358] "Generic (PLEG): container finished" podID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerID="b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b" exitCode=2 May 31 17:28:14.932957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.932886 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc9477688-fslkr" event={"ID":"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008","Type":"ContainerDied","Data":"b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b"} May 31 17:28:14.932957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.932896 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc9477688-fslkr" May 31 17:28:14.932957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.932913 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc9477688-fslkr" event={"ID":"2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008","Type":"ContainerDied","Data":"59e50d0d59735dc1b6dd0055b4b6637cc5f6501ab8d399b134156e087ca145e1"} May 31 17:28:14.932957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.932946 2567 scope.go:117] "RemoveContainer" containerID="b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b" May 31 17:28:14.941106 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.941086 2567 scope.go:117] "RemoveContainer" containerID="b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b" May 31 17:28:14.941374 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:28:14.941355 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b\": container with ID starting with b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b not found: ID does not exist" containerID="b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b" May 31 17:28:14.941439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.941383 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b"} err="failed to get container status \"b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b\": rpc error: code = NotFound desc = could not find container \"b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b\": container with ID starting with b635126b1af84d0ec726efbe84ec4ffb7a73b633a2d67cb1872c8021b5e8927b not found: ID does not exist" May 31 17:28:14.954226 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.954204 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc9477688-fslkr"] May 31 17:28:14.957634 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:14.957617 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc9477688-fslkr"] May 31 17:28:16.946031 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:16.945998 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" path="/var/lib/kubelet/pods/2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008/volumes" May 31 17:28:34.417510 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.417462 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c74dfcb66-284wv" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" containerID="cri-o://8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0" gracePeriod=15 May 31 17:28:34.663954 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.663911 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c74dfcb66-284wv_fa573285-9a51-4f77-94e0-1ff3d8c47786/console/0.log" May 31 17:28:34.664058 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.663987 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:28:34.723600 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723539 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-oauth-config\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.723600 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723576 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-config\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.723600 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723593 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-service-ca\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.723823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723614 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-oauth-serving-cert\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.723823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723666 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjbrm\" (UniqueName: \"kubernetes.io/projected/fa573285-9a51-4f77-94e0-1ff3d8c47786-kube-api-access-mjbrm\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.723823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723686 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-serving-cert\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.723823 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723708 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-trusted-ca-bundle\") pod \"fa573285-9a51-4f77-94e0-1ff3d8c47786\" (UID: \"fa573285-9a51-4f77-94e0-1ff3d8c47786\") " May 31 17:28:34.724058 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.723997 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:34.724128 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.724105 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-config" (OuterVolumeSpecName: "console-config") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:34.724245 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.724220 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:34.724303 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.724269 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:28:34.726030 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.726003 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:28:34.726401 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.726377 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa573285-9a51-4f77-94e0-1ff3d8c47786-kube-api-access-mjbrm" (OuterVolumeSpecName: "kube-api-access-mjbrm") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "kube-api-access-mjbrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:28:34.726401 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.726390 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa573285-9a51-4f77-94e0-1ff3d8c47786" (UID: "fa573285-9a51-4f77-94e0-1ff3d8c47786"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:28:34.824749 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824726 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-oauth-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.824749 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824747 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.824882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824756 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-service-ca\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.824882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824764 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-oauth-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.824882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824773 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjbrm\" (UniqueName: \"kubernetes.io/projected/fa573285-9a51-4f77-94e0-1ff3d8c47786-kube-api-access-mjbrm\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.824882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824782 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa573285-9a51-4f77-94e0-1ff3d8c47786-console-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.824882 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.824792 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa573285-9a51-4f77-94e0-1ff3d8c47786-trusted-ca-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:28:34.987096 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.987045 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c74dfcb66-284wv_fa573285-9a51-4f77-94e0-1ff3d8c47786/console/0.log" May 31 17:28:34.987096 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.987079 2567 generic.go:358] "Generic (PLEG): container finished" podID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerID="8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0" exitCode=2 May 31 17:28:34.987205 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.987102 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c74dfcb66-284wv" event={"ID":"fa573285-9a51-4f77-94e0-1ff3d8c47786","Type":"ContainerDied","Data":"8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0"} May 31 17:28:34.987205 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.987120 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c74dfcb66-284wv" event={"ID":"fa573285-9a51-4f77-94e0-1ff3d8c47786","Type":"ContainerDied","Data":"081f7576dd4199a671a4f1b5e26d46479dfd31cc0f5edb07032b496b7d8dcf12"} May 31 17:28:34.987205 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.987135 2567 scope.go:117] "RemoveContainer" containerID="8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0" May 31 17:28:34.987205 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.987137 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c74dfcb66-284wv" May 31 17:28:34.995137 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.995124 2567 scope.go:117] "RemoveContainer" containerID="8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0" May 31 17:28:34.995359 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:28:34.995343 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0\": container with ID starting with 8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0 not found: ID does not exist" containerID="8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0" May 31 17:28:34.995413 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:34.995366 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0"} err="failed to get container status \"8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0\": rpc error: code = NotFound desc = could not find container \"8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0\": container with ID starting with 8369246c979ece426b5053ec18be3e342371641133093d94d375943434b6a2d0 not found: ID does not exist" May 31 17:28:35.004452 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:35.004430 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c74dfcb66-284wv"] May 31 17:28:35.012132 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:35.012110 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c74dfcb66-284wv"] May 31 17:28:36.946448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:36.946418 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" path="/var/lib/kubelet/pods/fa573285-9a51-4f77-94e0-1ff3d8c47786/volumes" May 31 17:28:59.181724 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.181538 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-569dd475-vh9gk"] May 31 17:28:59.182688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.182665 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" May 31 17:28:59.182810 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.182798 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" May 31 17:28:59.182893 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.182884 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" May 31 17:28:59.182985 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.182975 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" May 31 17:28:59.183152 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.183142 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa573285-9a51-4f77-94e0-1ff3d8c47786" containerName="console" May 31 17:28:59.183240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.183231 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b4a3cc3-5e77-4aa1-ac2e-8342d71a4008" containerName="console" May 31 17:28:59.186439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.186416 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.197810 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.197774 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569dd475-vh9gk"] May 31 17:28:59.298628 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-service-ca\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.298765 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bmtq\" (UniqueName: \"kubernetes.io/projected/da355b69-152a-4375-ac2f-085753f27595-kube-api-access-9bmtq\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.298765 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-trusted-ca-bundle\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.298765 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-oauth-serving-cert\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.298765 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-oauth-config\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.298978 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-serving-cert\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.298978 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.298841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-console-config\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399194 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-service-ca\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399234 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bmtq\" (UniqueName: \"kubernetes.io/projected/da355b69-152a-4375-ac2f-085753f27595-kube-api-access-9bmtq\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399265 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-trusted-ca-bundle\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399292 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-oauth-serving-cert\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399328 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-oauth-config\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399552 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399374 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-serving-cert\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.399552 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.399420 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-console-config\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.400086 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.400036 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-service-ca\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.400184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.400104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-oauth-serving-cert\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.400262 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.400222 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-console-config\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.400713 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.400690 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-trusted-ca-bundle\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.402023 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.402000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-oauth-config\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.402110 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.402094 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-serving-cert\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.408657 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.408639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bmtq\" (UniqueName: \"kubernetes.io/projected/da355b69-152a-4375-ac2f-085753f27595-kube-api-access-9bmtq\") pod \"console-569dd475-vh9gk\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.495671 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.495619 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd475-vh9gk" May 31 17:28:59.621380 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.621352 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569dd475-vh9gk"] May 31 17:28:59.623816 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:28:59.623790 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda355b69_152a_4375_ac2f_085753f27595.slice/crio-2c99db8df78c71ee871f48382dfc6aa167744b44aadf010c21c05919d5be689d WatchSource:0}: Error finding container 2c99db8df78c71ee871f48382dfc6aa167744b44aadf010c21c05919d5be689d: Status 404 returned error can't find the container with id 2c99db8df78c71ee871f48382dfc6aa167744b44aadf010c21c05919d5be689d May 31 17:28:59.625654 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:28:59.625637 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:29:00.060439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:00.060410 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd475-vh9gk" event={"ID":"da355b69-152a-4375-ac2f-085753f27595","Type":"ContainerStarted","Data":"04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f"} May 31 17:29:00.060439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:00.060442 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd475-vh9gk" event={"ID":"da355b69-152a-4375-ac2f-085753f27595","Type":"ContainerStarted","Data":"2c99db8df78c71ee871f48382dfc6aa167744b44aadf010c21c05919d5be689d"} May 31 17:29:00.078368 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:00.078331 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-569dd475-vh9gk" podStartSLOduration=1.078317484 podStartE2EDuration="1.078317484s" podCreationTimestamp="2026-05-31 17:28:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:29:00.077611863 +0000 UTC m=+349.673965434" watchObservedRunningTime="2026-05-31 17:29:00.078317484 +0000 UTC m=+349.674671024" May 31 17:29:09.496728 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:09.496692 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-569dd475-vh9gk" May 31 17:29:09.497121 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:09.496737 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-569dd475-vh9gk" May 31 17:29:09.501343 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:09.501323 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-569dd475-vh9gk" May 31 17:29:10.092504 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:10.092475 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-569dd475-vh9gk" May 31 17:29:10.141145 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:10.141110 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-747f565d86-zwbwm"] May 31 17:29:35.163354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.163301 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-747f565d86-zwbwm" podUID="ddce6a98-ad2c-452e-beb8-71a406cc59da" containerName="console" containerID="cri-o://503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758" gracePeriod=15 May 31 17:29:35.405994 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.405973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-747f565d86-zwbwm_ddce6a98-ad2c-452e-beb8-71a406cc59da/console/0.log" May 31 17:29:35.406105 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.406031 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:29:35.561717 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.561692 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-oauth-config\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.561851 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.561727 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpnmw\" (UniqueName: \"kubernetes.io/projected/ddce6a98-ad2c-452e-beb8-71a406cc59da-kube-api-access-zpnmw\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.561851 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.561814 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-oauth-serving-cert\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.561997 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.561852 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-service-ca\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.561997 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.561954 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-serving-cert\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.561997 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.561989 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-config\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.562139 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.562022 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-trusted-ca-bundle\") pod \"ddce6a98-ad2c-452e-beb8-71a406cc59da\" (UID: \"ddce6a98-ad2c-452e-beb8-71a406cc59da\") " May 31 17:29:35.562343 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.562205 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:29:35.562343 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.562318 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:29:35.562678 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.562364 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-config" (OuterVolumeSpecName: "console-config") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:29:35.562678 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.562431 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:29:35.563957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.563916 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:29:35.564085 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.564061 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:29:35.564137 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.564106 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddce6a98-ad2c-452e-beb8-71a406cc59da-kube-api-access-zpnmw" (OuterVolumeSpecName: "kube-api-access-zpnmw") pod "ddce6a98-ad2c-452e-beb8-71a406cc59da" (UID: "ddce6a98-ad2c-452e-beb8-71a406cc59da"). InnerVolumeSpecName "kube-api-access-zpnmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:29:35.662933 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.662904 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-oauth-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:35.663045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.662948 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpnmw\" (UniqueName: \"kubernetes.io/projected/ddce6a98-ad2c-452e-beb8-71a406cc59da-kube-api-access-zpnmw\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:35.663045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.662964 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-oauth-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:35.663045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.662979 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-service-ca\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:35.663045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.662993 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:35.663045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.663005 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-console-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:35.663045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:35.663019 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddce6a98-ad2c-452e-beb8-71a406cc59da-trusted-ca-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:29:36.157757 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.157735 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-747f565d86-zwbwm_ddce6a98-ad2c-452e-beb8-71a406cc59da/console/0.log" May 31 17:29:36.157911 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.157772 2567 generic.go:358] "Generic (PLEG): container finished" podID="ddce6a98-ad2c-452e-beb8-71a406cc59da" containerID="503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758" exitCode=2 May 31 17:29:36.157911 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.157800 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747f565d86-zwbwm" event={"ID":"ddce6a98-ad2c-452e-beb8-71a406cc59da","Type":"ContainerDied","Data":"503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758"} May 31 17:29:36.157911 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.157838 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747f565d86-zwbwm" event={"ID":"ddce6a98-ad2c-452e-beb8-71a406cc59da","Type":"ContainerDied","Data":"409c8557606870dee84d246650c1b40189691e1d55c64f01bc440bd30976f062"} May 31 17:29:36.157911 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.157853 2567 scope.go:117] "RemoveContainer" containerID="503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758" May 31 17:29:36.158075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.157850 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747f565d86-zwbwm" May 31 17:29:36.167904 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.167887 2567 scope.go:117] "RemoveContainer" containerID="503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758" May 31 17:29:36.168194 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:29:36.168175 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758\": container with ID starting with 503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758 not found: ID does not exist" containerID="503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758" May 31 17:29:36.168240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.168201 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758"} err="failed to get container status \"503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758\": rpc error: code = NotFound desc = could not find container \"503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758\": container with ID starting with 503a780b6d7fcdd6b8d9a943c05c3b33e3ceef468e6c71d1c6c210861b809758 not found: ID does not exist" May 31 17:29:36.181612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.181581 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-747f565d86-zwbwm"] May 31 17:29:36.185940 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.185905 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-747f565d86-zwbwm"] May 31 17:29:36.945706 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:36.945677 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddce6a98-ad2c-452e-beb8-71a406cc59da" path="/var/lib/kubelet/pods/ddce6a98-ad2c-452e-beb8-71a406cc59da/volumes" May 31 17:29:48.848677 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.848634 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55"] May 31 17:29:48.849218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.849126 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddce6a98-ad2c-452e-beb8-71a406cc59da" containerName="console" May 31 17:29:48.849218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.849145 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddce6a98-ad2c-452e-beb8-71a406cc59da" containerName="console" May 31 17:29:48.849218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.849214 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddce6a98-ad2c-452e-beb8-71a406cc59da" containerName="console" May 31 17:29:48.853796 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.853776 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:48.856897 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.856878 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 31 17:29:48.857990 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.857972 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 31 17:29:48.858043 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.857972 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8vp4v\"" May 31 17:29:48.863605 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.863582 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55"] May 31 17:29:48.962971 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.962946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:48.963091 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.962980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:48.963091 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:48.963022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfmw\" (UniqueName: \"kubernetes.io/projected/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-kube-api-access-rdfmw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.064286 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.064250 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.064383 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.064296 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.064383 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.064324 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfmw\" (UniqueName: \"kubernetes.io/projected/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-kube-api-access-rdfmw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.064684 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.064662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.064759 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.064692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.073388 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.073366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfmw\" (UniqueName: \"kubernetes.io/projected/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-kube-api-access-rdfmw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.163494 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.163434 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:29:49.300888 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:49.300863 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55"] May 31 17:29:49.302866 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:29:49.302836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ec686d_d0e1_4ea7_a242_8f1cd8e72cbb.slice/crio-f27ea03ac773178e8fabf90546b0e79fb97ec092be7399ceb5d88ae56b94739b WatchSource:0}: Error finding container f27ea03ac773178e8fabf90546b0e79fb97ec092be7399ceb5d88ae56b94739b: Status 404 returned error can't find the container with id f27ea03ac773178e8fabf90546b0e79fb97ec092be7399ceb5d88ae56b94739b May 31 17:29:50.198688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:50.198641 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" event={"ID":"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb","Type":"ContainerStarted","Data":"f27ea03ac773178e8fabf90546b0e79fb97ec092be7399ceb5d88ae56b94739b"} May 31 17:29:55.213965 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:55.213875 2567 generic.go:358] "Generic (PLEG): container finished" podID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerID="a9c7bb4740f6fb0301efb59b2ce9a97008fb3fe646b333a41bd48ff13daa693f" exitCode=0 May 31 17:29:55.214304 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:29:55.213958 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" event={"ID":"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb","Type":"ContainerDied","Data":"a9c7bb4740f6fb0301efb59b2ce9a97008fb3fe646b333a41bd48ff13daa693f"} May 31 17:30:10.262538 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:10.262504 2567 generic.go:358] "Generic (PLEG): container finished" podID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerID="c0131d31d31d8a1b6eb5c28da6ce297f2ccd1a8d0dc78b2bb7aed127116cdcf6" exitCode=0 May 31 17:30:10.262904 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:10.262555 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" event={"ID":"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb","Type":"ContainerDied","Data":"c0131d31d31d8a1b6eb5c28da6ce297f2ccd1a8d0dc78b2bb7aed127116cdcf6"} May 31 17:30:17.290222 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:17.290189 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" event={"ID":"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb","Type":"ContainerStarted","Data":"1d6eba1779552f94c159703ea8a495d293358d0bc4c6ea4dc5f65716b0b3bf27"} May 31 17:30:17.309470 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:17.309409 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" podStartSLOduration=1.434007724 podStartE2EDuration="29.30939669s" podCreationTimestamp="2026-05-31 17:29:48 +0000 UTC" firstStartedPulling="2026-05-31 17:29:49.304723937 +0000 UTC m=+398.901077457" lastFinishedPulling="2026-05-31 17:30:17.180112904 +0000 UTC m=+426.776466423" observedRunningTime="2026-05-31 17:30:17.308325409 +0000 UTC m=+426.904678951" watchObservedRunningTime="2026-05-31 17:30:17.30939669 +0000 UTC m=+426.905750231" May 31 17:30:18.295061 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:18.295026 2567 generic.go:358] "Generic (PLEG): container finished" podID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerID="1d6eba1779552f94c159703ea8a495d293358d0bc4c6ea4dc5f65716b0b3bf27" exitCode=0 May 31 17:30:18.295435 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:18.295114 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" event={"ID":"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb","Type":"ContainerDied","Data":"1d6eba1779552f94c159703ea8a495d293358d0bc4c6ea4dc5f65716b0b3bf27"} May 31 17:30:19.421437 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.421416 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:30:19.491492 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.491456 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdfmw\" (UniqueName: \"kubernetes.io/projected/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-kube-api-access-rdfmw\") pod \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " May 31 17:30:19.491614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.491508 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-util\") pod \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " May 31 17:30:19.491614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.491536 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-bundle\") pod \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\" (UID: \"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb\") " May 31 17:30:19.492234 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.492204 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-bundle" (OuterVolumeSpecName: "bundle") pod "84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" (UID: "84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:30:19.493628 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.493610 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-kube-api-access-rdfmw" (OuterVolumeSpecName: "kube-api-access-rdfmw") pod "84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" (UID: "84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb"). InnerVolumeSpecName "kube-api-access-rdfmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:30:19.495475 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.495451 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-util" (OuterVolumeSpecName: "util") pod "84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" (UID: "84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:30:19.592367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.592342 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdfmw\" (UniqueName: \"kubernetes.io/projected/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-kube-api-access-rdfmw\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:19.592367 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.592362 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:19.592482 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:19.592373 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:20.302559 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:20.302524 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" May 31 17:30:20.302718 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:20.302523 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9fw55" event={"ID":"84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb","Type":"ContainerDied","Data":"f27ea03ac773178e8fabf90546b0e79fb97ec092be7399ceb5d88ae56b94739b"} May 31 17:30:20.302718 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:20.302645 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f27ea03ac773178e8fabf90546b0e79fb97ec092be7399ceb5d88ae56b94739b" May 31 17:30:27.301039 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301006 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8"] May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301310 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="util" May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301321 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="util" May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301328 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="extract" May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301333 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="extract" May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301346 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="pull" May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301352 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="pull" May 31 17:30:27.301423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.301399 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="84ec686d-d0e1-4ea7-a242-8f1cd8e72cbb" containerName="extract" May 31 17:30:27.305426 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.305408 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.310025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.309996 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 31 17:30:27.310125 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.310032 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bx8wz\"" May 31 17:30:27.310125 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.310071 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 31 17:30:27.322992 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.322963 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8"] May 31 17:30:27.343390 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.343366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab22d70c-2111-4700-bc64-8e5b639c19b9-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zcjt8\" (UID: \"ab22d70c-2111-4700-bc64-8e5b639c19b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.343491 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.343427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qsbc\" (UniqueName: \"kubernetes.io/projected/ab22d70c-2111-4700-bc64-8e5b639c19b9-kube-api-access-2qsbc\") pod \"cert-manager-operator-controller-manager-54b9655956-zcjt8\" (UID: \"ab22d70c-2111-4700-bc64-8e5b639c19b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.444164 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.444128 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qsbc\" (UniqueName: \"kubernetes.io/projected/ab22d70c-2111-4700-bc64-8e5b639c19b9-kube-api-access-2qsbc\") pod \"cert-manager-operator-controller-manager-54b9655956-zcjt8\" (UID: \"ab22d70c-2111-4700-bc64-8e5b639c19b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.444264 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.444208 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab22d70c-2111-4700-bc64-8e5b639c19b9-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zcjt8\" (UID: \"ab22d70c-2111-4700-bc64-8e5b639c19b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.444606 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.444588 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab22d70c-2111-4700-bc64-8e5b639c19b9-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zcjt8\" (UID: \"ab22d70c-2111-4700-bc64-8e5b639c19b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.453418 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.453393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qsbc\" (UniqueName: \"kubernetes.io/projected/ab22d70c-2111-4700-bc64-8e5b639c19b9-kube-api-access-2qsbc\") pod \"cert-manager-operator-controller-manager-54b9655956-zcjt8\" (UID: \"ab22d70c-2111-4700-bc64-8e5b639c19b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.614753 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.614699 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" May 31 17:30:27.752034 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:27.751993 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8"] May 31 17:30:27.755778 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:30:27.755737 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab22d70c_2111_4700_bc64_8e5b639c19b9.slice/crio-63ee47b5db31475425d26a6f5248b5ee58da6965942751eda80dc82bd13b75bd WatchSource:0}: Error finding container 63ee47b5db31475425d26a6f5248b5ee58da6965942751eda80dc82bd13b75bd: Status 404 returned error can't find the container with id 63ee47b5db31475425d26a6f5248b5ee58da6965942751eda80dc82bd13b75bd May 31 17:30:28.328265 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:28.328235 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" event={"ID":"ab22d70c-2111-4700-bc64-8e5b639c19b9","Type":"ContainerStarted","Data":"63ee47b5db31475425d26a6f5248b5ee58da6965942751eda80dc82bd13b75bd"} May 31 17:30:30.336599 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:30.336550 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" event={"ID":"ab22d70c-2111-4700-bc64-8e5b639c19b9","Type":"ContainerStarted","Data":"35f6708a755717adf25e1dfb88f3525d3b67631571af7f3f59ff466b7dfd17e7"} May 31 17:30:30.363149 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:30.363093 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zcjt8" podStartSLOduration=1.412868979 podStartE2EDuration="3.363080649s" podCreationTimestamp="2026-05-31 17:30:27 +0000 UTC" firstStartedPulling="2026-05-31 17:30:27.758227873 +0000 UTC m=+437.354581396" lastFinishedPulling="2026-05-31 17:30:29.708439544 +0000 UTC m=+439.304793066" observedRunningTime="2026-05-31 17:30:30.361463989 +0000 UTC m=+439.957817529" watchObservedRunningTime="2026-05-31 17:30:30.363080649 +0000 UTC m=+439.959434190" May 31 17:30:31.528670 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.528637 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp"] May 31 17:30:31.532129 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.532112 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.534939 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.534906 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 31 17:30:31.535136 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.535117 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8vp4v\"" May 31 17:30:31.536185 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.536168 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 31 17:30:31.549005 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.548983 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp"] May 31 17:30:31.576698 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.576675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.576806 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.576715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.576806 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.576741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvht8\" (UniqueName: \"kubernetes.io/projected/0e2d8fcd-2771-49ea-945f-a46d8dddf781-kube-api-access-mvht8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.677465 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.677442 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvht8\" (UniqueName: \"kubernetes.io/projected/0e2d8fcd-2771-49ea-945f-a46d8dddf781-kube-api-access-mvht8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.677537 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.677491 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.677537 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.677528 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.677943 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.677906 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.677987 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.677947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.686255 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.686236 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvht8\" (UniqueName: \"kubernetes.io/projected/0e2d8fcd-2771-49ea-945f-a46d8dddf781-kube-api-access-mvht8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.841118 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.841085 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:31.966592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:31.966569 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp"] May 31 17:30:31.969099 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:30:31.969065 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2d8fcd_2771_49ea_945f_a46d8dddf781.slice/crio-dbe9a60c4e93b3a724efd581b2215143a560c1ae7765fb9eadc8309e7ef67ed5 WatchSource:0}: Error finding container dbe9a60c4e93b3a724efd581b2215143a560c1ae7765fb9eadc8309e7ef67ed5: Status 404 returned error can't find the container with id dbe9a60c4e93b3a724efd581b2215143a560c1ae7765fb9eadc8309e7ef67ed5 May 31 17:30:32.218878 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.218805 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-h7csk"] May 31 17:30:32.221866 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.221845 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.225621 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.225593 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7r8gl\"" May 31 17:30:32.225707 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.225695 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 31 17:30:32.225761 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.225710 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 31 17:30:32.236895 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.236859 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-h7csk"] May 31 17:30:32.282845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.282819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrzd\" (UniqueName: \"kubernetes.io/projected/c02efa6d-5878-4c6a-af3c-73757c1ddffe-kube-api-access-nkrzd\") pod \"cert-manager-webhook-587ccfb98-h7csk\" (UID: \"c02efa6d-5878-4c6a-af3c-73757c1ddffe\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.282977 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.282863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c02efa6d-5878-4c6a-af3c-73757c1ddffe-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-h7csk\" (UID: \"c02efa6d-5878-4c6a-af3c-73757c1ddffe\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.344053 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.344027 2567 generic.go:358] "Generic (PLEG): container finished" podID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerID="0bcec05910e843612cea08ff8a1bbefb33b0d4ef243cf7e3844b0feb721e53bc" exitCode=0 May 31 17:30:32.344146 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.344090 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" event={"ID":"0e2d8fcd-2771-49ea-945f-a46d8dddf781","Type":"ContainerDied","Data":"0bcec05910e843612cea08ff8a1bbefb33b0d4ef243cf7e3844b0feb721e53bc"} May 31 17:30:32.344146 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.344119 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" event={"ID":"0e2d8fcd-2771-49ea-945f-a46d8dddf781","Type":"ContainerStarted","Data":"dbe9a60c4e93b3a724efd581b2215143a560c1ae7765fb9eadc8309e7ef67ed5"} May 31 17:30:32.383808 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.383788 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrzd\" (UniqueName: \"kubernetes.io/projected/c02efa6d-5878-4c6a-af3c-73757c1ddffe-kube-api-access-nkrzd\") pod \"cert-manager-webhook-587ccfb98-h7csk\" (UID: \"c02efa6d-5878-4c6a-af3c-73757c1ddffe\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.383944 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.383822 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c02efa6d-5878-4c6a-af3c-73757c1ddffe-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-h7csk\" (UID: \"c02efa6d-5878-4c6a-af3c-73757c1ddffe\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.392450 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.392428 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrzd\" (UniqueName: \"kubernetes.io/projected/c02efa6d-5878-4c6a-af3c-73757c1ddffe-kube-api-access-nkrzd\") pod \"cert-manager-webhook-587ccfb98-h7csk\" (UID: \"c02efa6d-5878-4c6a-af3c-73757c1ddffe\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.392513 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.392472 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c02efa6d-5878-4c6a-af3c-73757c1ddffe-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-h7csk\" (UID: \"c02efa6d-5878-4c6a-af3c-73757c1ddffe\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.540407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.540348 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:32.662827 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:32.662800 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-h7csk"] May 31 17:30:32.664939 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:30:32.664899 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc02efa6d_5878_4c6a_af3c_73757c1ddffe.slice/crio-6bb67ec92e755b85e53add872bf53f93feb4816c196db8eda3ad6bbbd520ff62 WatchSource:0}: Error finding container 6bb67ec92e755b85e53add872bf53f93feb4816c196db8eda3ad6bbbd520ff62: Status 404 returned error can't find the container with id 6bb67ec92e755b85e53add872bf53f93feb4816c196db8eda3ad6bbbd520ff62 May 31 17:30:33.348325 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:33.348294 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" event={"ID":"c02efa6d-5878-4c6a-af3c-73757c1ddffe","Type":"ContainerStarted","Data":"6bb67ec92e755b85e53add872bf53f93feb4816c196db8eda3ad6bbbd520ff62"} May 31 17:30:34.354221 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.354184 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-qxfsv"] May 31 17:30:34.357539 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.357518 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.360596 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.360577 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rwqjh\"" May 31 17:30:34.367891 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.367867 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-qxfsv"] May 31 17:30:34.399672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.399648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a341485d-a2b0-4124-8b03-204bac7a3331-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-qxfsv\" (UID: \"a341485d-a2b0-4124-8b03-204bac7a3331\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.399764 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.399701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnb5\" (UniqueName: \"kubernetes.io/projected/a341485d-a2b0-4124-8b03-204bac7a3331-kube-api-access-8pnb5\") pod \"cert-manager-cainjector-68b757865b-qxfsv\" (UID: \"a341485d-a2b0-4124-8b03-204bac7a3331\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.500852 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.500825 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnb5\" (UniqueName: \"kubernetes.io/projected/a341485d-a2b0-4124-8b03-204bac7a3331-kube-api-access-8pnb5\") pod \"cert-manager-cainjector-68b757865b-qxfsv\" (UID: \"a341485d-a2b0-4124-8b03-204bac7a3331\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.500966 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.500883 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a341485d-a2b0-4124-8b03-204bac7a3331-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-qxfsv\" (UID: \"a341485d-a2b0-4124-8b03-204bac7a3331\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.510893 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.510872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a341485d-a2b0-4124-8b03-204bac7a3331-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-qxfsv\" (UID: \"a341485d-a2b0-4124-8b03-204bac7a3331\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.511296 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.511277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnb5\" (UniqueName: \"kubernetes.io/projected/a341485d-a2b0-4124-8b03-204bac7a3331-kube-api-access-8pnb5\") pod \"cert-manager-cainjector-68b757865b-qxfsv\" (UID: \"a341485d-a2b0-4124-8b03-204bac7a3331\") " pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.667344 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.667267 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" May 31 17:30:34.817746 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:34.817719 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-qxfsv"] May 31 17:30:34.819869 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:30:34.819841 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda341485d_a2b0_4124_8b03_204bac7a3331.slice/crio-22c11992fedb5b80636e3c6d5f6df4f951c8372fbe836403edb76dd410bdaf00 WatchSource:0}: Error finding container 22c11992fedb5b80636e3c6d5f6df4f951c8372fbe836403edb76dd410bdaf00: Status 404 returned error can't find the container with id 22c11992fedb5b80636e3c6d5f6df4f951c8372fbe836403edb76dd410bdaf00 May 31 17:30:35.356179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:35.356139 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" event={"ID":"a341485d-a2b0-4124-8b03-204bac7a3331","Type":"ContainerStarted","Data":"22c11992fedb5b80636e3c6d5f6df4f951c8372fbe836403edb76dd410bdaf00"} May 31 17:30:37.366240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:37.366203 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" event={"ID":"0e2d8fcd-2771-49ea-945f-a46d8dddf781","Type":"ContainerStarted","Data":"ae2e1dc51ef2109ceb16961acf235e92f2c978236c050eecd7b06bb059b43c7d"} May 31 17:30:38.372078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:38.372040 2567 generic.go:358] "Generic (PLEG): container finished" podID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerID="ae2e1dc51ef2109ceb16961acf235e92f2c978236c050eecd7b06bb059b43c7d" exitCode=0 May 31 17:30:38.372526 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:38.372133 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" event={"ID":"0e2d8fcd-2771-49ea-945f-a46d8dddf781","Type":"ContainerDied","Data":"ae2e1dc51ef2109ceb16961acf235e92f2c978236c050eecd7b06bb059b43c7d"} May 31 17:30:38.373705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:38.373658 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" event={"ID":"c02efa6d-5878-4c6a-af3c-73757c1ddffe","Type":"ContainerStarted","Data":"023ccb3559df84fd05cb2574ad11ebf7c1d4d9a2a228fd6c1ebb13237f59164b"} May 31 17:30:38.373833 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:38.373777 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:38.421638 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:38.421590 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" podStartSLOduration=1.183591997 podStartE2EDuration="6.421574066s" podCreationTimestamp="2026-05-31 17:30:32 +0000 UTC" firstStartedPulling="2026-05-31 17:30:32.666727656 +0000 UTC m=+442.263081176" lastFinishedPulling="2026-05-31 17:30:37.904709725 +0000 UTC m=+447.501063245" observedRunningTime="2026-05-31 17:30:38.420586362 +0000 UTC m=+448.016939917" watchObservedRunningTime="2026-05-31 17:30:38.421574066 +0000 UTC m=+448.017927603" May 31 17:30:39.379050 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:39.379016 2567 generic.go:358] "Generic (PLEG): container finished" podID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerID="007e05e29ccf99bf94df5f298746a2ea79772e3232cf9faa0d35accbf5799591" exitCode=0 May 31 17:30:39.379418 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:39.379109 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" event={"ID":"0e2d8fcd-2771-49ea-945f-a46d8dddf781","Type":"ContainerDied","Data":"007e05e29ccf99bf94df5f298746a2ea79772e3232cf9faa0d35accbf5799591"} May 31 17:30:39.380460 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:39.380442 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" event={"ID":"a341485d-a2b0-4124-8b03-204bac7a3331","Type":"ContainerStarted","Data":"3451c1f28ce937a532baa2702822b3d0c8d1bd529644e63d9cacc9d05f9ba421"} May 31 17:30:39.419075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:39.419034 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-qxfsv" podStartSLOduration=1.6998703659999999 podStartE2EDuration="5.419021608s" podCreationTimestamp="2026-05-31 17:30:34 +0000 UTC" firstStartedPulling="2026-05-31 17:30:34.822165533 +0000 UTC m=+444.418519066" lastFinishedPulling="2026-05-31 17:30:38.541316789 +0000 UTC m=+448.137670308" observedRunningTime="2026-05-31 17:30:39.417093778 +0000 UTC m=+449.013447318" watchObservedRunningTime="2026-05-31 17:30:39.419021608 +0000 UTC m=+449.015375148" May 31 17:30:40.513144 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.513119 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:40.653634 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.653550 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-util\") pod \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " May 31 17:30:40.653634 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.653596 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvht8\" (UniqueName: \"kubernetes.io/projected/0e2d8fcd-2771-49ea-945f-a46d8dddf781-kube-api-access-mvht8\") pod \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " May 31 17:30:40.653634 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.653616 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-bundle\") pod \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\" (UID: \"0e2d8fcd-2771-49ea-945f-a46d8dddf781\") " May 31 17:30:40.654067 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.654035 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-bundle" (OuterVolumeSpecName: "bundle") pod "0e2d8fcd-2771-49ea-945f-a46d8dddf781" (UID: "0e2d8fcd-2771-49ea-945f-a46d8dddf781"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:30:40.655829 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.655811 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2d8fcd-2771-49ea-945f-a46d8dddf781-kube-api-access-mvht8" (OuterVolumeSpecName: "kube-api-access-mvht8") pod "0e2d8fcd-2771-49ea-945f-a46d8dddf781" (UID: "0e2d8fcd-2771-49ea-945f-a46d8dddf781"). InnerVolumeSpecName "kube-api-access-mvht8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:30:40.658285 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.658263 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-util" (OuterVolumeSpecName: "util") pod "0e2d8fcd-2771-49ea-945f-a46d8dddf781" (UID: "0e2d8fcd-2771-49ea-945f-a46d8dddf781"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:30:40.755038 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.755011 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:40.755038 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.755037 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvht8\" (UniqueName: \"kubernetes.io/projected/0e2d8fcd-2771-49ea-945f-a46d8dddf781-kube-api-access-mvht8\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:40.755167 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:40.755052 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e2d8fcd-2771-49ea-945f-a46d8dddf781-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:41.387395 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:41.387373 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" May 31 17:30:41.387527 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:41.387372 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs52sp" event={"ID":"0e2d8fcd-2771-49ea-945f-a46d8dddf781","Type":"ContainerDied","Data":"dbe9a60c4e93b3a724efd581b2215143a560c1ae7765fb9eadc8309e7ef67ed5"} May 31 17:30:41.387527 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:41.387475 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbe9a60c4e93b3a724efd581b2215143a560c1ae7765fb9eadc8309e7ef67ed5" May 31 17:30:44.383176 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:44.383141 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-h7csk" May 31 17:30:46.120493 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120453 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78"] May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120817 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="pull" May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120830 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="pull" May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120842 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="extract" May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120847 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="extract" May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120858 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="util" May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120875 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="util" May 31 17:30:46.120949 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.120934 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e2d8fcd-2771-49ea-945f-a46d8dddf781" containerName="extract" May 31 17:30:46.176721 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.176692 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78"] May 31 17:30:46.176850 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.176783 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.179491 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.179467 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 31 17:30:46.180395 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.180377 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-j452n\"" May 31 17:30:46.180395 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.180385 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 31 17:30:46.293812 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.293788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5zl\" (UniqueName: \"kubernetes.io/projected/7d9205dc-efb5-42d9-b0e2-a415389977fe-kube-api-access-qm5zl\") pod \"openshift-lws-operator-bfc7f696d-xdm78\" (UID: \"7d9205dc-efb5-42d9-b0e2-a415389977fe\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.293950 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.293837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d9205dc-efb5-42d9-b0e2-a415389977fe-tmp\") pod \"openshift-lws-operator-bfc7f696d-xdm78\" (UID: \"7d9205dc-efb5-42d9-b0e2-a415389977fe\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.394387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.394323 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d9205dc-efb5-42d9-b0e2-a415389977fe-tmp\") pod \"openshift-lws-operator-bfc7f696d-xdm78\" (UID: \"7d9205dc-efb5-42d9-b0e2-a415389977fe\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.394490 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.394400 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5zl\" (UniqueName: \"kubernetes.io/projected/7d9205dc-efb5-42d9-b0e2-a415389977fe-kube-api-access-qm5zl\") pod \"openshift-lws-operator-bfc7f696d-xdm78\" (UID: \"7d9205dc-efb5-42d9-b0e2-a415389977fe\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.394656 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.394637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d9205dc-efb5-42d9-b0e2-a415389977fe-tmp\") pod \"openshift-lws-operator-bfc7f696d-xdm78\" (UID: \"7d9205dc-efb5-42d9-b0e2-a415389977fe\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.405447 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.405420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5zl\" (UniqueName: \"kubernetes.io/projected/7d9205dc-efb5-42d9-b0e2-a415389977fe-kube-api-access-qm5zl\") pod \"openshift-lws-operator-bfc7f696d-xdm78\" (UID: \"7d9205dc-efb5-42d9-b0e2-a415389977fe\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.486388 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.486350 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" May 31 17:30:46.624687 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:46.624664 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78"] May 31 17:30:46.626563 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:30:46.626532 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d9205dc_efb5_42d9_b0e2_a415389977fe.slice/crio-4fdd47fe4d1b61a0ee081762f7d2af5a425c4275dda5b5e7f5c5b6abc7951219 WatchSource:0}: Error finding container 4fdd47fe4d1b61a0ee081762f7d2af5a425c4275dda5b5e7f5c5b6abc7951219: Status 404 returned error can't find the container with id 4fdd47fe4d1b61a0ee081762f7d2af5a425c4275dda5b5e7f5c5b6abc7951219 May 31 17:30:47.407403 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:47.407373 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" event={"ID":"7d9205dc-efb5-42d9-b0e2-a415389977fe","Type":"ContainerStarted","Data":"4fdd47fe4d1b61a0ee081762f7d2af5a425c4275dda5b5e7f5c5b6abc7951219"} May 31 17:30:50.417965 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:50.417908 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" event={"ID":"7d9205dc-efb5-42d9-b0e2-a415389977fe","Type":"ContainerStarted","Data":"a12c47361ad3b9b060a48292a83288e2c50d2b0f5824ac1a3abeb588295e8ceb"} May 31 17:30:50.436388 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:50.436334 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xdm78" podStartSLOduration=1.1212855 podStartE2EDuration="4.436316569s" podCreationTimestamp="2026-05-31 17:30:46 +0000 UTC" firstStartedPulling="2026-05-31 17:30:46.628048076 +0000 UTC m=+456.224401596" lastFinishedPulling="2026-05-31 17:30:49.943079146 +0000 UTC m=+459.539432665" observedRunningTime="2026-05-31 17:30:50.43506137 +0000 UTC m=+460.031414913" watchObservedRunningTime="2026-05-31 17:30:50.436316569 +0000 UTC m=+460.032670111" May 31 17:30:52.784724 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.784687 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9"] May 31 17:30:52.787175 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.787155 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:52.790040 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.790016 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 31 17:30:52.790595 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.790578 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8vp4v\"" May 31 17:30:52.791133 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.791116 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 31 17:30:52.799259 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.799234 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9"] May 31 17:30:52.945442 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.945417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdfv\" (UniqueName: \"kubernetes.io/projected/fcd39b18-c021-4f46-a998-7e20e210df20-kube-api-access-ftdfv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:52.945567 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.945468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:52.945567 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:52.945496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.046044 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.045982 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.046044 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.046023 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdfv\" (UniqueName: \"kubernetes.io/projected/fcd39b18-c021-4f46-a998-7e20e210df20-kube-api-access-ftdfv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.046219 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.046072 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.046393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.046373 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.046445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.046422 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.058020 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.057993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdfv\" (UniqueName: \"kubernetes.io/projected/fcd39b18-c021-4f46-a998-7e20e210df20-kube-api-access-ftdfv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.097179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.097150 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:53.236107 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.236062 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9"] May 31 17:30:53.238449 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:30:53.238420 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd39b18_c021_4f46_a998_7e20e210df20.slice/crio-3cf39e731fae9e495ab51500cfefc81d8c3fbf4a1c14f7caf9c3dbcb5dba7231 WatchSource:0}: Error finding container 3cf39e731fae9e495ab51500cfefc81d8c3fbf4a1c14f7caf9c3dbcb5dba7231: Status 404 returned error can't find the container with id 3cf39e731fae9e495ab51500cfefc81d8c3fbf4a1c14f7caf9c3dbcb5dba7231 May 31 17:30:53.430419 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.430389 2567 generic.go:358] "Generic (PLEG): container finished" podID="fcd39b18-c021-4f46-a998-7e20e210df20" containerID="5d848caa2a2514a854fc05a71e646b4ca7e7fbacc26370f13141b49017082e7d" exitCode=0 May 31 17:30:53.430545 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.430433 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" event={"ID":"fcd39b18-c021-4f46-a998-7e20e210df20","Type":"ContainerDied","Data":"5d848caa2a2514a854fc05a71e646b4ca7e7fbacc26370f13141b49017082e7d"} May 31 17:30:53.430545 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:53.430485 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" event={"ID":"fcd39b18-c021-4f46-a998-7e20e210df20","Type":"ContainerStarted","Data":"3cf39e731fae9e495ab51500cfefc81d8c3fbf4a1c14f7caf9c3dbcb5dba7231"} May 31 17:30:54.435840 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:54.435809 2567 generic.go:358] "Generic (PLEG): container finished" podID="fcd39b18-c021-4f46-a998-7e20e210df20" containerID="13d04989c2ad977b15068692120c318972047c40eccede0e934c710760cbd495" exitCode=0 May 31 17:30:54.436204 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:54.435903 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" event={"ID":"fcd39b18-c021-4f46-a998-7e20e210df20","Type":"ContainerDied","Data":"13d04989c2ad977b15068692120c318972047c40eccede0e934c710760cbd495"} May 31 17:30:55.440877 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:55.440842 2567 generic.go:358] "Generic (PLEG): container finished" podID="fcd39b18-c021-4f46-a998-7e20e210df20" containerID="bd9c95711aac28c6dd066f66cdef2e989c523db5a389e67811566252d085b73e" exitCode=0 May 31 17:30:55.441244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:55.440952 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" event={"ID":"fcd39b18-c021-4f46-a998-7e20e210df20","Type":"ContainerDied","Data":"bd9c95711aac28c6dd066f66cdef2e989c523db5a389e67811566252d085b73e"} May 31 17:30:56.568746 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.568715 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:30:56.672879 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.672839 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftdfv\" (UniqueName: \"kubernetes.io/projected/fcd39b18-c021-4f46-a998-7e20e210df20-kube-api-access-ftdfv\") pod \"fcd39b18-c021-4f46-a998-7e20e210df20\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " May 31 17:30:56.673025 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.672980 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-util\") pod \"fcd39b18-c021-4f46-a998-7e20e210df20\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " May 31 17:30:56.673074 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.673047 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-bundle\") pod \"fcd39b18-c021-4f46-a998-7e20e210df20\" (UID: \"fcd39b18-c021-4f46-a998-7e20e210df20\") " May 31 17:30:56.673699 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.673667 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-bundle" (OuterVolumeSpecName: "bundle") pod "fcd39b18-c021-4f46-a998-7e20e210df20" (UID: "fcd39b18-c021-4f46-a998-7e20e210df20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:30:56.675005 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.674984 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd39b18-c021-4f46-a998-7e20e210df20-kube-api-access-ftdfv" (OuterVolumeSpecName: "kube-api-access-ftdfv") pod "fcd39b18-c021-4f46-a998-7e20e210df20" (UID: "fcd39b18-c021-4f46-a998-7e20e210df20"). InnerVolumeSpecName "kube-api-access-ftdfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:30:56.678521 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.678498 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-util" (OuterVolumeSpecName: "util") pod "fcd39b18-c021-4f46-a998-7e20e210df20" (UID: "fcd39b18-c021-4f46-a998-7e20e210df20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:30:56.773593 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.773539 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftdfv\" (UniqueName: \"kubernetes.io/projected/fcd39b18-c021-4f46-a998-7e20e210df20-kube-api-access-ftdfv\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:56.773593 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.773559 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:56.773593 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:56.773569 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcd39b18-c021-4f46-a998-7e20e210df20-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:30:57.449183 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:57.449142 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" event={"ID":"fcd39b18-c021-4f46-a998-7e20e210df20","Type":"ContainerDied","Data":"3cf39e731fae9e495ab51500cfefc81d8c3fbf4a1c14f7caf9c3dbcb5dba7231"} May 31 17:30:57.449183 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:57.449177 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cf39e731fae9e495ab51500cfefc81d8c3fbf4a1c14f7caf9c3dbcb5dba7231" May 31 17:30:57.449434 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:30:57.449209 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5shk9" May 31 17:31:06.664838 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.664800 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9"] May 31 17:31:06.665240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665148 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="extract" May 31 17:31:06.665240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665163 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="extract" May 31 17:31:06.665240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665181 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="util" May 31 17:31:06.665240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665186 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="util" May 31 17:31:06.665240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665192 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="pull" May 31 17:31:06.665240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665197 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="pull" May 31 17:31:06.665438 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.665259 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcd39b18-c021-4f46-a998-7e20e210df20" containerName="extract" May 31 17:31:06.668300 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.668283 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.672017 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.671994 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hqdxb\"" May 31 17:31:06.672389 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.672366 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 31 17:31:06.672472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.672395 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 31 17:31:06.672472 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.672414 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 31 17:31:06.672585 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.672517 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 31 17:31:06.685884 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.685856 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9"] May 31 17:31:06.748602 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.748573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmxz\" (UniqueName: \"kubernetes.io/projected/914a7975-8500-48da-b8db-6b51d1327c79-kube-api-access-vmmxz\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.748724 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.748627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/914a7975-8500-48da-b8db-6b51d1327c79-tmp\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.748724 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.748689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/914a7975-8500-48da-b8db-6b51d1327c79-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.748828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.748721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/914a7975-8500-48da-b8db-6b51d1327c79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.748828 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.748753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/914a7975-8500-48da-b8db-6b51d1327c79-manifests\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.849555 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.849532 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/914a7975-8500-48da-b8db-6b51d1327c79-manifests\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.849660 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.849573 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmmxz\" (UniqueName: \"kubernetes.io/projected/914a7975-8500-48da-b8db-6b51d1327c79-kube-api-access-vmmxz\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.849660 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.849604 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/914a7975-8500-48da-b8db-6b51d1327c79-tmp\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.849660 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.849636 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/914a7975-8500-48da-b8db-6b51d1327c79-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.849660 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.849659 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/914a7975-8500-48da-b8db-6b51d1327c79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.849890 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.849870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/914a7975-8500-48da-b8db-6b51d1327c79-manifests\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.852181 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.852154 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/914a7975-8500-48da-b8db-6b51d1327c79-tmp\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.852286 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.852263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/914a7975-8500-48da-b8db-6b51d1327c79-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.852361 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.852346 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/914a7975-8500-48da-b8db-6b51d1327c79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.865093 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.865071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmmxz\" (UniqueName: \"kubernetes.io/projected/914a7975-8500-48da-b8db-6b51d1327c79-kube-api-access-vmmxz\") pod \"opendatahub-operator-controller-manager-cd7c7f585-wjpv9\" (UID: \"914a7975-8500-48da-b8db-6b51d1327c79\") " pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:06.977808 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:06.977749 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:07.137280 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:07.137257 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9"] May 31 17:31:07.139185 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:07.139154 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914a7975_8500_48da_b8db_6b51d1327c79.slice/crio-54b8a73f04d227051e7e7337861056dc6138aa28a180c37314cc7b1a2bdc33fc WatchSource:0}: Error finding container 54b8a73f04d227051e7e7337861056dc6138aa28a180c37314cc7b1a2bdc33fc: Status 404 returned error can't find the container with id 54b8a73f04d227051e7e7337861056dc6138aa28a180c37314cc7b1a2bdc33fc May 31 17:31:07.483445 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:07.483406 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" event={"ID":"914a7975-8500-48da-b8db-6b51d1327c79","Type":"ContainerStarted","Data":"54b8a73f04d227051e7e7337861056dc6138aa28a180c37314cc7b1a2bdc33fc"} May 31 17:31:10.495914 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:10.495878 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" event={"ID":"914a7975-8500-48da-b8db-6b51d1327c79","Type":"ContainerStarted","Data":"d5bd2f312b5d7a001040430c419ccf1fa85a1b8c37c065c8bfd7711565dac15b"} May 31 17:31:11.502379 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:11.502333 2567 generic.go:358] "Generic (PLEG): container finished" podID="914a7975-8500-48da-b8db-6b51d1327c79" containerID="d5bd2f312b5d7a001040430c419ccf1fa85a1b8c37c065c8bfd7711565dac15b" exitCode=0 May 31 17:31:11.502781 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:11.502415 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" event={"ID":"914a7975-8500-48da-b8db-6b51d1327c79","Type":"ContainerDied","Data":"d5bd2f312b5d7a001040430c419ccf1fa85a1b8c37c065c8bfd7711565dac15b"} May 31 17:31:12.507265 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:12.507225 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" event={"ID":"914a7975-8500-48da-b8db-6b51d1327c79","Type":"ContainerStarted","Data":"e99ac6fb932eaaff69090fc760fee81eb73e4f13861822848162940072e8a949"} May 31 17:31:12.507618 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:12.507413 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:12.530346 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:12.530298 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" podStartSLOduration=1.890931725 podStartE2EDuration="6.530287167s" podCreationTimestamp="2026-05-31 17:31:06 +0000 UTC" firstStartedPulling="2026-05-31 17:31:07.140955209 +0000 UTC m=+476.737308728" lastFinishedPulling="2026-05-31 17:31:11.78031064 +0000 UTC m=+481.376664170" observedRunningTime="2026-05-31 17:31:12.528112314 +0000 UTC m=+482.124465856" watchObservedRunningTime="2026-05-31 17:31:12.530287167 +0000 UTC m=+482.126640746" May 31 17:31:23.513068 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:23.513038 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cd7c7f585-wjpv9" May 31 17:31:25.885870 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.885838 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8"] May 31 17:31:25.895462 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.895439 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:25.900354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.900325 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 31 17:31:25.900354 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.900346 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 31 17:31:25.900528 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.900483 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jsm22\"" May 31 17:31:25.902511 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.902487 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8"] May 31 17:31:25.913000 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.912977 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb"] May 31 17:31:25.917274 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.917258 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:25.920552 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.920535 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 31 17:31:25.920650 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.920538 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 31 17:31:25.920650 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.920562 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8vp4v\"" May 31 17:31:25.932130 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.932111 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb"] May 31 17:31:25.994507 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.994487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d9aa310-b475-4ddd-ae75-58427979f34d-tmp\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:25.994612 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.994530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6q7j\" (UniqueName: \"kubernetes.io/projected/1d9aa310-b475-4ddd-ae75-58427979f34d-kube-api-access-s6q7j\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:25.994679 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.994662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9aa310-b475-4ddd-ae75-58427979f34d-tls-certs\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:25.994725 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.994711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:25.994797 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.994784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:25.994990 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:25.994971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbm6\" (UniqueName: \"kubernetes.io/projected/efa69a8d-a1fc-479e-9ad6-b81297993f69-kube-api-access-pxbm6\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.018422 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.018396 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-lvljq"] May 31 17:31:26.021876 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.021861 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.025582 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.025564 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 31 17:31:26.025790 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.025777 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sjnlx\"" May 31 17:31:26.035352 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.035330 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-lvljq"] May 31 17:31:26.095779 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095751 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6q7j\" (UniqueName: \"kubernetes.io/projected/1d9aa310-b475-4ddd-ae75-58427979f34d-kube-api-access-s6q7j\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.095906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095785 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9aa310-b475-4ddd-ae75-58427979f34d-tls-certs\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.095906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7dr\" (UniqueName: \"kubernetes.io/projected/0e8016da-af97-4979-a009-cac52fc21655-kube-api-access-bk7dr\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.095906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095832 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.095906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095851 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.096164 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095895 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbm6\" (UniqueName: \"kubernetes.io/projected/efa69a8d-a1fc-479e-9ad6-b81297993f69-kube-api-access-pxbm6\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.096164 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.095972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.096164 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.096009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d9aa310-b475-4ddd-ae75-58427979f34d-tmp\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.096297 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.096210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.096297 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.096241 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.098323 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.098292 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d9aa310-b475-4ddd-ae75-58427979f34d-tmp\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.098493 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.098475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9aa310-b475-4ddd-ae75-58427979f34d-tls-certs\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.107262 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.107242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbm6\" (UniqueName: \"kubernetes.io/projected/efa69a8d-a1fc-479e-9ad6-b81297993f69-kube-api-access-pxbm6\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.107368 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.107313 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6q7j\" (UniqueName: \"kubernetes.io/projected/1d9aa310-b475-4ddd-ae75-58427979f34d-kube-api-access-s6q7j\") pod \"kube-auth-proxy-6ccddbf6bf-5fxc8\" (UID: \"1d9aa310-b475-4ddd-ae75-58427979f34d\") " pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.196677 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.196623 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7dr\" (UniqueName: \"kubernetes.io/projected/0e8016da-af97-4979-a009-cac52fc21655-kube-api-access-bk7dr\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.196677 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.196671 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.196807 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:31:26.196742 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 31 17:31:26.196807 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:31:26.196798 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert podName:0e8016da-af97-4979-a009-cac52fc21655 nodeName:}" failed. No retries permitted until 2026-05-31 17:31:26.696782595 +0000 UTC m=+496.293136114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert") pod "odh-model-controller-76588b95-lvljq" (UID: "0e8016da-af97-4979-a009-cac52fc21655") : secret "odh-model-controller-webhook-cert" not found May 31 17:31:26.206603 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.206577 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" May 31 17:31:26.210401 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.210381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7dr\" (UniqueName: \"kubernetes.io/projected/0e8016da-af97-4979-a009-cac52fc21655-kube-api-access-bk7dr\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.225848 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.225824 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:26.352272 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.352238 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8"] May 31 17:31:26.354376 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:26.354344 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9aa310_b475_4ddd_ae75_58427979f34d.slice/crio-ef548951cdded990782e8ca02531589fb0d7508791f1a2fb9c2b24448d979c59 WatchSource:0}: Error finding container ef548951cdded990782e8ca02531589fb0d7508791f1a2fb9c2b24448d979c59: Status 404 returned error can't find the container with id ef548951cdded990782e8ca02531589fb0d7508791f1a2fb9c2b24448d979c59 May 31 17:31:26.371932 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.371898 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb"] May 31 17:31:26.373356 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:26.373329 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa69a8d_a1fc_479e_9ad6_b81297993f69.slice/crio-8ef1a671b4de7c140c6a7eb49dd2215e0b2c931ed706a80e99fdd7285d0bde6a WatchSource:0}: Error finding container 8ef1a671b4de7c140c6a7eb49dd2215e0b2c931ed706a80e99fdd7285d0bde6a: Status 404 returned error can't find the container with id 8ef1a671b4de7c140c6a7eb49dd2215e0b2c931ed706a80e99fdd7285d0bde6a May 31 17:31:26.555893 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.555865 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" event={"ID":"1d9aa310-b475-4ddd-ae75-58427979f34d","Type":"ContainerStarted","Data":"ef548951cdded990782e8ca02531589fb0d7508791f1a2fb9c2b24448d979c59"} May 31 17:31:26.557260 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.557233 2567 generic.go:358] "Generic (PLEG): container finished" podID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerID="949cf9ce6441129d7041f68e1fbf4e0be462cea2f7d3a1434c1673add7066cfe" exitCode=0 May 31 17:31:26.557362 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.557304 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" event={"ID":"efa69a8d-a1fc-479e-9ad6-b81297993f69","Type":"ContainerDied","Data":"949cf9ce6441129d7041f68e1fbf4e0be462cea2f7d3a1434c1673add7066cfe"} May 31 17:31:26.557362 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.557323 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" event={"ID":"efa69a8d-a1fc-479e-9ad6-b81297993f69","Type":"ContainerStarted","Data":"8ef1a671b4de7c140c6a7eb49dd2215e0b2c931ed706a80e99fdd7285d0bde6a"} May 31 17:31:26.700821 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.700786 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:26.701064 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:31:26.700942 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 31 17:31:26.701064 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:31:26.701000 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert podName:0e8016da-af97-4979-a009-cac52fc21655 nodeName:}" failed. No retries permitted until 2026-05-31 17:31:27.700985825 +0000 UTC m=+497.297339344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert") pod "odh-model-controller-76588b95-lvljq" (UID: "0e8016da-af97-4979-a009-cac52fc21655") : secret "odh-model-controller-webhook-cert" not found May 31 17:31:26.952792 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.952755 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-p4zv7"] May 31 17:31:26.956532 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.956501 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:26.959568 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.959539 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" May 31 17:31:26.978773 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:26.978748 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-p4zv7"] May 31 17:31:27.003292 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.003262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb96467-2e98-4778-80e8-9efc438fa553-tls-certs\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.003450 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.003360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcj9q\" (UniqueName: \"kubernetes.io/projected/8eb96467-2e98-4778-80e8-9efc438fa553-kube-api-access-gcj9q\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.104681 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.104648 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcj9q\" (UniqueName: \"kubernetes.io/projected/8eb96467-2e98-4778-80e8-9efc438fa553-kube-api-access-gcj9q\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.104829 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.104777 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb96467-2e98-4778-80e8-9efc438fa553-tls-certs\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.104968 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:31:27.104910 2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found May 31 17:31:27.105026 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:31:27.105004 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb96467-2e98-4778-80e8-9efc438fa553-tls-certs podName:8eb96467-2e98-4778-80e8-9efc438fa553 nodeName:}" failed. No retries permitted until 2026-05-31 17:31:27.604981788 +0000 UTC m=+497.201335313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8eb96467-2e98-4778-80e8-9efc438fa553-tls-certs") pod "model-serving-api-6577596cd5-p4zv7" (UID: "8eb96467-2e98-4778-80e8-9efc438fa553") : secret "model-serving-api-tls" not found May 31 17:31:27.116662 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.116637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcj9q\" (UniqueName: \"kubernetes.io/projected/8eb96467-2e98-4778-80e8-9efc438fa553-kube-api-access-gcj9q\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.562958 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.562903 2567 generic.go:358] "Generic (PLEG): container finished" podID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerID="09cf0faaccea4140862b508119cff702545348b8a41d553b5f017513a80a128f" exitCode=0 May 31 17:31:27.563085 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.562962 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" event={"ID":"efa69a8d-a1fc-479e-9ad6-b81297993f69","Type":"ContainerDied","Data":"09cf0faaccea4140862b508119cff702545348b8a41d553b5f017513a80a128f"} May 31 17:31:27.608507 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.608470 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb96467-2e98-4778-80e8-9efc438fa553-tls-certs\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.611380 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.611353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eb96467-2e98-4778-80e8-9efc438fa553-tls-certs\") pod \"model-serving-api-6577596cd5-p4zv7\" (UID: \"8eb96467-2e98-4778-80e8-9efc438fa553\") " pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:27.709934 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.709845 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:27.712712 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.712684 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8016da-af97-4979-a009-cac52fc21655-cert\") pod \"odh-model-controller-76588b95-lvljq\" (UID: \"0e8016da-af97-4979-a009-cac52fc21655\") " pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:27.831984 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.831951 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:27.870785 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:27.870752 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:28.507100 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:28.507067 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-lvljq"] May 31 17:31:28.510095 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:28.510054 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8016da_af97_4979_a009_cac52fc21655.slice/crio-49182bf2fe99ea64c079fa2e66f2c1186db28c4acaaeab8cf8e5b3489057d3cd WatchSource:0}: Error finding container 49182bf2fe99ea64c079fa2e66f2c1186db28c4acaaeab8cf8e5b3489057d3cd: Status 404 returned error can't find the container with id 49182bf2fe99ea64c079fa2e66f2c1186db28c4acaaeab8cf8e5b3489057d3cd May 31 17:31:28.525272 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:28.525251 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-p4zv7"] May 31 17:31:28.527279 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:28.527257 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb96467_2e98_4778_80e8_9efc438fa553.slice/crio-fed1e6c81b3519655b9e2875b9e2d10c457fd3c137f843d8e27f08062e8016bf WatchSource:0}: Error finding container fed1e6c81b3519655b9e2875b9e2d10c457fd3c137f843d8e27f08062e8016bf: Status 404 returned error can't find the container with id fed1e6c81b3519655b9e2875b9e2d10c457fd3c137f843d8e27f08062e8016bf May 31 17:31:28.567672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:28.567642 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-lvljq" event={"ID":"0e8016da-af97-4979-a009-cac52fc21655","Type":"ContainerStarted","Data":"49182bf2fe99ea64c079fa2e66f2c1186db28c4acaaeab8cf8e5b3489057d3cd"} May 31 17:31:28.569682 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:28.569658 2567 generic.go:358] "Generic (PLEG): container finished" podID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerID="652460900e5440c95e1b3b7d58c64c6fac2fb4400c4a372bc3f36b4c13e79d10" exitCode=0 May 31 17:31:28.569784 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:28.569719 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" event={"ID":"efa69a8d-a1fc-479e-9ad6-b81297993f69","Type":"ContainerDied","Data":"652460900e5440c95e1b3b7d58c64c6fac2fb4400c4a372bc3f36b4c13e79d10"} May 31 17:31:28.570815 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:28.570789 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" event={"ID":"8eb96467-2e98-4778-80e8-9efc438fa553","Type":"ContainerStarted","Data":"fed1e6c81b3519655b9e2875b9e2d10c457fd3c137f843d8e27f08062e8016bf"} May 31 17:31:29.578091 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.578049 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" event={"ID":"1d9aa310-b475-4ddd-ae75-58427979f34d","Type":"ContainerStarted","Data":"57157ab1330820003d6ed614309be047989c762a33628a25328c25b634e9cc66"} May 31 17:31:29.597160 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.596613 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ccddbf6bf-5fxc8" podStartSLOduration=1.6843859380000001 podStartE2EDuration="4.596594213s" podCreationTimestamp="2026-05-31 17:31:25 +0000 UTC" firstStartedPulling="2026-05-31 17:31:26.356210021 +0000 UTC m=+495.952563543" lastFinishedPulling="2026-05-31 17:31:29.268418295 +0000 UTC m=+498.864771818" observedRunningTime="2026-05-31 17:31:29.593768014 +0000 UTC m=+499.190121554" watchObservedRunningTime="2026-05-31 17:31:29.596594213 +0000 UTC m=+499.192947758" May 31 17:31:29.758363 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.758336 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:29.832743 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.832671 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxbm6\" (UniqueName: \"kubernetes.io/projected/efa69a8d-a1fc-479e-9ad6-b81297993f69-kube-api-access-pxbm6\") pod \"efa69a8d-a1fc-479e-9ad6-b81297993f69\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " May 31 17:31:29.832743 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.832721 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-bundle\") pod \"efa69a8d-a1fc-479e-9ad6-b81297993f69\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " May 31 17:31:29.832991 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.832758 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-util\") pod \"efa69a8d-a1fc-479e-9ad6-b81297993f69\" (UID: \"efa69a8d-a1fc-479e-9ad6-b81297993f69\") " May 31 17:31:29.834626 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.834589 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-bundle" (OuterVolumeSpecName: "bundle") pod "efa69a8d-a1fc-479e-9ad6-b81297993f69" (UID: "efa69a8d-a1fc-479e-9ad6-b81297993f69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:31:29.836194 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.835598 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa69a8d-a1fc-479e-9ad6-b81297993f69-kube-api-access-pxbm6" (OuterVolumeSpecName: "kube-api-access-pxbm6") pod "efa69a8d-a1fc-479e-9ad6-b81297993f69" (UID: "efa69a8d-a1fc-479e-9ad6-b81297993f69"). InnerVolumeSpecName "kube-api-access-pxbm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:31:29.842315 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.842290 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-util" (OuterVolumeSpecName: "util") pod "efa69a8d-a1fc-479e-9ad6-b81297993f69" (UID: "efa69a8d-a1fc-479e-9ad6-b81297993f69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:31:29.934414 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.934380 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxbm6\" (UniqueName: \"kubernetes.io/projected/efa69a8d-a1fc-479e-9ad6-b81297993f69-kube-api-access-pxbm6\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:31:29.934414 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.934412 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:31:29.934414 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:29.934422 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa69a8d-a1fc-479e-9ad6-b81297993f69-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:31:30.584750 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:30.584715 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" event={"ID":"efa69a8d-a1fc-479e-9ad6-b81297993f69","Type":"ContainerDied","Data":"8ef1a671b4de7c140c6a7eb49dd2215e0b2c931ed706a80e99fdd7285d0bde6a"} May 31 17:31:30.584750 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:30.584756 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ef1a671b4de7c140c6a7eb49dd2215e0b2c931ed706a80e99fdd7285d0bde6a" May 31 17:31:30.585157 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:30.584763 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835vkfpb" May 31 17:31:32.594751 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:32.594711 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" event={"ID":"8eb96467-2e98-4778-80e8-9efc438fa553","Type":"ContainerStarted","Data":"2848c8a0ddf51f719723c85d2cf3c481ec209f058b29817ec8aeeda3b21a5308"} May 31 17:31:32.595197 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:32.594827 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:32.596252 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:32.596229 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-lvljq" event={"ID":"0e8016da-af97-4979-a009-cac52fc21655","Type":"ContainerStarted","Data":"82e7a385c84c78542df94973b188d6e5ba3f89bd52ff653dee684ffd916da5a9"} May 31 17:31:32.596412 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:32.596400 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:32.639054 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:32.639009 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-lvljq" podStartSLOduration=4.329191699 podStartE2EDuration="7.638997195s" podCreationTimestamp="2026-05-31 17:31:25 +0000 UTC" firstStartedPulling="2026-05-31 17:31:28.512094684 +0000 UTC m=+498.108448219" lastFinishedPulling="2026-05-31 17:31:31.82190018 +0000 UTC m=+501.418253715" observedRunningTime="2026-05-31 17:31:32.637578826 +0000 UTC m=+502.233932366" watchObservedRunningTime="2026-05-31 17:31:32.638997195 +0000 UTC m=+502.235350735" May 31 17:31:32.639566 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:32.639543 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" podStartSLOduration=3.390441928 podStartE2EDuration="6.639537624s" podCreationTimestamp="2026-05-31 17:31:26 +0000 UTC" firstStartedPulling="2026-05-31 17:31:28.528883836 +0000 UTC m=+498.125237356" lastFinishedPulling="2026-05-31 17:31:31.777979533 +0000 UTC m=+501.374333052" observedRunningTime="2026-05-31 17:31:32.617069392 +0000 UTC m=+502.213422943" watchObservedRunningTime="2026-05-31 17:31:32.639537624 +0000 UTC m=+502.235891210" May 31 17:31:35.363662 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.363596 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt"] May 31 17:31:35.364184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364107 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="util" May 31 17:31:35.364184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364125 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="util" May 31 17:31:35.364184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364143 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="pull" May 31 17:31:35.364184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364161 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="pull" May 31 17:31:35.364184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364176 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="extract" May 31 17:31:35.364184 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364184 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="extract" May 31 17:31:35.364485 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.364267 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="efa69a8d-a1fc-479e-9ad6-b81297993f69" containerName="extract" May 31 17:31:35.367643 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.367621 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.370602 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.370580 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8vp4v\"" May 31 17:31:35.370718 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.370620 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 31 17:31:35.370875 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.370859 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 31 17:31:35.379411 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.379391 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt"] May 31 17:31:35.481679 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.481649 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.481794 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.481701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnl6\" (UniqueName: \"kubernetes.io/projected/d45b22c8-b2e8-4bce-a856-97f338ffc13e-kube-api-access-2qnl6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.481835 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.481787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.583075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.583042 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnl6\" (UniqueName: \"kubernetes.io/projected/d45b22c8-b2e8-4bce-a856-97f338ffc13e-kube-api-access-2qnl6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.583218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.583094 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.583218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.583126 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.583460 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.583444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.583531 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.583505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.610261 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.610240 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnl6\" (UniqueName: \"kubernetes.io/projected/d45b22c8-b2e8-4bce-a856-97f338ffc13e-kube-api-access-2qnl6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.676971 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.676900 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:35.887209 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:35.886982 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt"] May 31 17:31:35.889449 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:35.889420 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45b22c8_b2e8_4bce_a856_97f338ffc13e.slice/crio-42d31af4575bc55d0e29440fb94175bf2134becd5e9b6f4e09656031e954419c WatchSource:0}: Error finding container 42d31af4575bc55d0e29440fb94175bf2134becd5e9b6f4e09656031e954419c: Status 404 returned error can't find the container with id 42d31af4575bc55d0e29440fb94175bf2134becd5e9b6f4e09656031e954419c May 31 17:31:36.612542 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:36.612502 2567 generic.go:358] "Generic (PLEG): container finished" podID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerID="de884db280226ddec1d0ee47f03952fc2449536d723860e4d01032bcb7d4acd1" exitCode=0 May 31 17:31:36.612897 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:36.612553 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" event={"ID":"d45b22c8-b2e8-4bce-a856-97f338ffc13e","Type":"ContainerDied","Data":"de884db280226ddec1d0ee47f03952fc2449536d723860e4d01032bcb7d4acd1"} May 31 17:31:36.612897 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:36.612583 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" event={"ID":"d45b22c8-b2e8-4bce-a856-97f338ffc13e","Type":"ContainerStarted","Data":"42d31af4575bc55d0e29440fb94175bf2134becd5e9b6f4e09656031e954419c"} May 31 17:31:37.617699 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:37.617665 2567 generic.go:358] "Generic (PLEG): container finished" podID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerID="b9d30644aabad047d75f4fef6a243dc34043dd067abc965752c1a99ffb465c7b" exitCode=0 May 31 17:31:37.618076 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:37.617732 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" event={"ID":"d45b22c8-b2e8-4bce-a856-97f338ffc13e","Type":"ContainerDied","Data":"b9d30644aabad047d75f4fef6a243dc34043dd067abc965752c1a99ffb465c7b"} May 31 17:31:38.623043 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:38.623011 2567 generic.go:358] "Generic (PLEG): container finished" podID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerID="db2105ad336e52f63ecb0aa09fe5df3b955aef6d2f5ed85609a1f0046654c724" exitCode=0 May 31 17:31:38.623382 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:38.623068 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" event={"ID":"d45b22c8-b2e8-4bce-a856-97f338ffc13e","Type":"ContainerDied","Data":"db2105ad336e52f63ecb0aa09fe5df3b955aef6d2f5ed85609a1f0046654c724"} May 31 17:31:39.330751 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.330719 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s"] May 31 17:31:39.334474 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.334449 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.338590 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.338566 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cbdn9\"" May 31 17:31:39.338842 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.338824 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 31 17:31:39.365163 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.365141 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn"] May 31 17:31:39.368362 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.368348 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.374116 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.374097 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wpx8h\"" May 31 17:31:39.374646 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.374631 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" May 31 17:31:39.391053 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.391033 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s"] May 31 17:31:39.393126 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.393108 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn"] May 31 17:31:39.414775 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.414750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2e70580-7f71-41a8-824c-71cc3c05e22a-cert\") pod \"kserve-controller-manager-7c99ffcdcd-87g2s\" (UID: \"e2e70580-7f71-41a8-824c-71cc3c05e22a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.414870 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.414790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81c18406-534a-4fd3-871d-801bdb459377-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dsxzn\" (UID: \"81c18406-534a-4fd3-871d-801bdb459377\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.414914 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.414894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w7ts\" (UniqueName: \"kubernetes.io/projected/e2e70580-7f71-41a8-824c-71cc3c05e22a-kube-api-access-6w7ts\") pod \"kserve-controller-manager-7c99ffcdcd-87g2s\" (UID: \"e2e70580-7f71-41a8-824c-71cc3c05e22a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.414985 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.414941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ssc5\" (UniqueName: \"kubernetes.io/projected/81c18406-534a-4fd3-871d-801bdb459377-kube-api-access-4ssc5\") pod \"llmisvc-controller-manager-c6b9847d7-dsxzn\" (UID: \"81c18406-534a-4fd3-871d-801bdb459377\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.516179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.516148 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w7ts\" (UniqueName: \"kubernetes.io/projected/e2e70580-7f71-41a8-824c-71cc3c05e22a-kube-api-access-6w7ts\") pod \"kserve-controller-manager-7c99ffcdcd-87g2s\" (UID: \"e2e70580-7f71-41a8-824c-71cc3c05e22a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.516287 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.516184 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ssc5\" (UniqueName: \"kubernetes.io/projected/81c18406-534a-4fd3-871d-801bdb459377-kube-api-access-4ssc5\") pod \"llmisvc-controller-manager-c6b9847d7-dsxzn\" (UID: \"81c18406-534a-4fd3-871d-801bdb459377\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.516287 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.516215 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2e70580-7f71-41a8-824c-71cc3c05e22a-cert\") pod \"kserve-controller-manager-7c99ffcdcd-87g2s\" (UID: \"e2e70580-7f71-41a8-824c-71cc3c05e22a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.516401 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.516297 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81c18406-534a-4fd3-871d-801bdb459377-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dsxzn\" (UID: \"81c18406-534a-4fd3-871d-801bdb459377\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.518854 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.518834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81c18406-534a-4fd3-871d-801bdb459377-cert\") pod \"llmisvc-controller-manager-c6b9847d7-dsxzn\" (UID: \"81c18406-534a-4fd3-871d-801bdb459377\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.518958 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.518842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2e70580-7f71-41a8-824c-71cc3c05e22a-cert\") pod \"kserve-controller-manager-7c99ffcdcd-87g2s\" (UID: \"e2e70580-7f71-41a8-824c-71cc3c05e22a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.573811 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.573787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w7ts\" (UniqueName: \"kubernetes.io/projected/e2e70580-7f71-41a8-824c-71cc3c05e22a-kube-api-access-6w7ts\") pod \"kserve-controller-manager-7c99ffcdcd-87g2s\" (UID: \"e2e70580-7f71-41a8-824c-71cc3c05e22a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.578875 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.578848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ssc5\" (UniqueName: \"kubernetes.io/projected/81c18406-534a-4fd3-871d-801bdb459377-kube-api-access-4ssc5\") pod \"llmisvc-controller-manager-c6b9847d7-dsxzn\" (UID: \"81c18406-534a-4fd3-871d-801bdb459377\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.646549 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.646518 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:39.677387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.677327 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:39.778299 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.777121 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:39.820629 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.820601 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-util\") pod \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " May 31 17:31:39.820857 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.820698 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qnl6\" (UniqueName: \"kubernetes.io/projected/d45b22c8-b2e8-4bce-a856-97f338ffc13e-kube-api-access-2qnl6\") pod \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " May 31 17:31:39.820857 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.820734 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-bundle\") pod \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\" (UID: \"d45b22c8-b2e8-4bce-a856-97f338ffc13e\") " May 31 17:31:39.822493 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.822460 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-bundle" (OuterVolumeSpecName: "bundle") pod "d45b22c8-b2e8-4bce-a856-97f338ffc13e" (UID: "d45b22c8-b2e8-4bce-a856-97f338ffc13e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:31:39.824482 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.824319 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45b22c8-b2e8-4bce-a856-97f338ffc13e-kube-api-access-2qnl6" (OuterVolumeSpecName: "kube-api-access-2qnl6") pod "d45b22c8-b2e8-4bce-a856-97f338ffc13e" (UID: "d45b22c8-b2e8-4bce-a856-97f338ffc13e"). InnerVolumeSpecName "kube-api-access-2qnl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:31:39.827712 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.827688 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-util" (OuterVolumeSpecName: "util") pod "d45b22c8-b2e8-4bce-a856-97f338ffc13e" (UID: "d45b22c8-b2e8-4bce-a856-97f338ffc13e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:31:39.850558 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.850529 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s"] May 31 17:31:39.851865 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:39.851841 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e70580_7f71_41a8_824c_71cc3c05e22a.slice/crio-3789eb804c5d6308158268f1bad88867af2f07b71b9f28cc8ef3d7908c13b9c7 WatchSource:0}: Error finding container 3789eb804c5d6308158268f1bad88867af2f07b71b9f28cc8ef3d7908c13b9c7: Status 404 returned error can't find the container with id 3789eb804c5d6308158268f1bad88867af2f07b71b9f28cc8ef3d7908c13b9c7 May 31 17:31:39.877113 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.877049 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn"] May 31 17:31:39.879716 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:39.879691 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81c18406_534a_4fd3_871d_801bdb459377.slice/crio-8c08ba845eeddd4178584fd23928674d0eb984c5aaaf0c55296cea7b28f57026 WatchSource:0}: Error finding container 8c08ba845eeddd4178584fd23928674d0eb984c5aaaf0c55296cea7b28f57026: Status 404 returned error can't find the container with id 8c08ba845eeddd4178584fd23928674d0eb984c5aaaf0c55296cea7b28f57026 May 31 17:31:39.922226 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.922200 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:31:39.922305 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.922228 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qnl6\" (UniqueName: \"kubernetes.io/projected/d45b22c8-b2e8-4bce-a856-97f338ffc13e-kube-api-access-2qnl6\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:31:39.922305 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:39.922245 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d45b22c8-b2e8-4bce-a856-97f338ffc13e-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:31:40.632745 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:40.632709 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" event={"ID":"e2e70580-7f71-41a8-824c-71cc3c05e22a","Type":"ContainerStarted","Data":"3789eb804c5d6308158268f1bad88867af2f07b71b9f28cc8ef3d7908c13b9c7"} May 31 17:31:40.634217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:40.634183 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" event={"ID":"81c18406-534a-4fd3-871d-801bdb459377","Type":"ContainerStarted","Data":"8c08ba845eeddd4178584fd23928674d0eb984c5aaaf0c55296cea7b28f57026"} May 31 17:31:40.636187 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:40.636163 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" event={"ID":"d45b22c8-b2e8-4bce-a856-97f338ffc13e","Type":"ContainerDied","Data":"42d31af4575bc55d0e29440fb94175bf2134becd5e9b6f4e09656031e954419c"} May 31 17:31:40.636187 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:40.636191 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42d31af4575bc55d0e29440fb94175bf2134becd5e9b6f4e09656031e954419c" May 31 17:31:40.636349 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:40.636282 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6qmtt" May 31 17:31:42.675462 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.675429 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7db85b7c5b-v469t"] May 31 17:31:42.675986 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.675968 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="extract" May 31 17:31:42.676030 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.675989 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="extract" May 31 17:31:42.676030 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.676002 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="util" May 31 17:31:42.676030 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.676010 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="util" May 31 17:31:42.676119 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.676035 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="pull" May 31 17:31:42.676119 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.676043 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="pull" May 31 17:31:42.676179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.676119 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="d45b22c8-b2e8-4bce-a856-97f338ffc13e" containerName="extract" May 31 17:31:42.700562 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.700258 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:42.700963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.700729 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7db85b7c5b-v469t"] May 31 17:31:42.704672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.704597 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" May 31 17:31:42.711971 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.711895 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mqw7d\"" May 31 17:31:42.747471 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.747446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2306cbd8-9816-4cd6-a342-24da5bed083b-redirect-config\") pod \"dashboard-redirect-7db85b7c5b-v469t\" (UID: \"2306cbd8-9816-4cd6-a342-24da5bed083b\") " pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:42.747567 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.747482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drq5x\" (UniqueName: \"kubernetes.io/projected/2306cbd8-9816-4cd6-a342-24da5bed083b-kube-api-access-drq5x\") pod \"dashboard-redirect-7db85b7c5b-v469t\" (UID: \"2306cbd8-9816-4cd6-a342-24da5bed083b\") " pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:42.848793 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.848759 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2306cbd8-9816-4cd6-a342-24da5bed083b-redirect-config\") pod \"dashboard-redirect-7db85b7c5b-v469t\" (UID: \"2306cbd8-9816-4cd6-a342-24da5bed083b\") " pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:42.849013 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.848822 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drq5x\" (UniqueName: \"kubernetes.io/projected/2306cbd8-9816-4cd6-a342-24da5bed083b-kube-api-access-drq5x\") pod \"dashboard-redirect-7db85b7c5b-v469t\" (UID: \"2306cbd8-9816-4cd6-a342-24da5bed083b\") " pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:42.849592 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.849565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2306cbd8-9816-4cd6-a342-24da5bed083b-redirect-config\") pod \"dashboard-redirect-7db85b7c5b-v469t\" (UID: \"2306cbd8-9816-4cd6-a342-24da5bed083b\") " pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:42.875218 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:42.875186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drq5x\" (UniqueName: \"kubernetes.io/projected/2306cbd8-9816-4cd6-a342-24da5bed083b-kube-api-access-drq5x\") pod \"dashboard-redirect-7db85b7c5b-v469t\" (UID: \"2306cbd8-9816-4cd6-a342-24da5bed083b\") " pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:43.014392 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.014327 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" May 31 17:31:43.212593 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.212564 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7db85b7c5b-v469t"] May 31 17:31:43.213875 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:43.213847 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2306cbd8_9816_4cd6_a342_24da5bed083b.slice/crio-a780587960744d78af1aba173a45d9229cee7214f3fd13fc2c9fb5781de891b5 WatchSource:0}: Error finding container a780587960744d78af1aba173a45d9229cee7214f3fd13fc2c9fb5781de891b5: Status 404 returned error can't find the container with id a780587960744d78af1aba173a45d9229cee7214f3fd13fc2c9fb5781de891b5 May 31 17:31:43.603250 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.603222 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-lvljq" May 31 17:31:43.604998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.604976 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-p4zv7" May 31 17:31:43.652303 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.652269 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" event={"ID":"e2e70580-7f71-41a8-824c-71cc3c05e22a","Type":"ContainerStarted","Data":"643e31302767c6f8001e55fa66c8c8d9ae8956329b5a5df549b4b5015d1b7bb9"} May 31 17:31:43.652439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.652385 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:31:43.653707 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.653681 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" event={"ID":"81c18406-534a-4fd3-871d-801bdb459377","Type":"ContainerStarted","Data":"f6e37ec306e49af3709b7b16d058c5259d0b49dec5b9c9908eb677a980951760"} May 31 17:31:43.653825 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.653746 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:31:43.654772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.654754 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" event={"ID":"2306cbd8-9816-4cd6-a342-24da5bed083b","Type":"ContainerStarted","Data":"a780587960744d78af1aba173a45d9229cee7214f3fd13fc2c9fb5781de891b5"} May 31 17:31:43.736460 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.736416 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" podStartSLOduration=1.583991111 podStartE2EDuration="4.736403705s" podCreationTimestamp="2026-05-31 17:31:39 +0000 UTC" firstStartedPulling="2026-05-31 17:31:39.880915848 +0000 UTC m=+509.477269367" lastFinishedPulling="2026-05-31 17:31:43.033328442 +0000 UTC m=+512.629681961" observedRunningTime="2026-05-31 17:31:43.735784447 +0000 UTC m=+513.332137989" watchObservedRunningTime="2026-05-31 17:31:43.736403705 +0000 UTC m=+513.332757260" May 31 17:31:43.853771 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:43.853674 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" podStartSLOduration=1.6759364319999999 podStartE2EDuration="4.853660526s" podCreationTimestamp="2026-05-31 17:31:39 +0000 UTC" firstStartedPulling="2026-05-31 17:31:39.853294121 +0000 UTC m=+509.449647640" lastFinishedPulling="2026-05-31 17:31:43.031018212 +0000 UTC m=+512.627371734" observedRunningTime="2026-05-31 17:31:43.844544014 +0000 UTC m=+513.440897556" watchObservedRunningTime="2026-05-31 17:31:43.853660526 +0000 UTC m=+513.450014067" May 31 17:31:45.036428 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.036398 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-t96nb"] May 31 17:31:45.039767 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.039751 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.042549 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.042524 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-cvwz6\"" May 31 17:31:45.042839 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.042811 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 31 17:31:45.042951 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.042900 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 31 17:31:45.055408 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.055368 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-t96nb"] May 31 17:31:45.171597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.171572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8flx\" (UniqueName: \"kubernetes.io/projected/0d271c7e-4e2e-4f8e-babd-662dce648914-kube-api-access-c8flx\") pod \"servicemesh-operator3-55f49c5f94-t96nb\" (UID: \"0d271c7e-4e2e-4f8e-babd-662dce648914\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.171718 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.171658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d271c7e-4e2e-4f8e-babd-662dce648914-operator-config\") pod \"servicemesh-operator3-55f49c5f94-t96nb\" (UID: \"0d271c7e-4e2e-4f8e-babd-662dce648914\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.272830 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.272805 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d271c7e-4e2e-4f8e-babd-662dce648914-operator-config\") pod \"servicemesh-operator3-55f49c5f94-t96nb\" (UID: \"0d271c7e-4e2e-4f8e-babd-662dce648914\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.272959 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.272853 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8flx\" (UniqueName: \"kubernetes.io/projected/0d271c7e-4e2e-4f8e-babd-662dce648914-kube-api-access-c8flx\") pod \"servicemesh-operator3-55f49c5f94-t96nb\" (UID: \"0d271c7e-4e2e-4f8e-babd-662dce648914\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.275459 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.275433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d271c7e-4e2e-4f8e-babd-662dce648914-operator-config\") pod \"servicemesh-operator3-55f49c5f94-t96nb\" (UID: \"0d271c7e-4e2e-4f8e-babd-662dce648914\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.283577 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.283555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8flx\" (UniqueName: \"kubernetes.io/projected/0d271c7e-4e2e-4f8e-babd-662dce648914-kube-api-access-c8flx\") pod \"servicemesh-operator3-55f49c5f94-t96nb\" (UID: \"0d271c7e-4e2e-4f8e-babd-662dce648914\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.348963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.348942 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:45.500050 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.500021 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-t96nb"] May 31 17:31:45.501704 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:45.501676 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d271c7e_4e2e_4f8e_babd_662dce648914.slice/crio-4b4043a5c050ceb30f6d9efbe0ee00d622263b92286a3cd819cbcbc13572c75e WatchSource:0}: Error finding container 4b4043a5c050ceb30f6d9efbe0ee00d622263b92286a3cd819cbcbc13572c75e: Status 404 returned error can't find the container with id 4b4043a5c050ceb30f6d9efbe0ee00d622263b92286a3cd819cbcbc13572c75e May 31 17:31:45.663796 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:45.663724 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" event={"ID":"0d271c7e-4e2e-4f8e-babd-662dce648914","Type":"ContainerStarted","Data":"4b4043a5c050ceb30f6d9efbe0ee00d622263b92286a3cd819cbcbc13572c75e"} May 31 17:31:46.669836 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:46.669780 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" event={"ID":"2306cbd8-9816-4cd6-a342-24da5bed083b","Type":"ContainerStarted","Data":"41158b8e1389a09bafa6f1547d99ce8152417cb21ae904a37dbd8020e44dd38f"} May 31 17:31:46.692709 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:46.692651 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7db85b7c5b-v469t" podStartSLOduration=1.852527518 podStartE2EDuration="4.692635954s" podCreationTimestamp="2026-05-31 17:31:42 +0000 UTC" firstStartedPulling="2026-05-31 17:31:43.21529265 +0000 UTC m=+512.811646169" lastFinishedPulling="2026-05-31 17:31:46.055401071 +0000 UTC m=+515.651754605" observedRunningTime="2026-05-31 17:31:46.692071529 +0000 UTC m=+516.288425072" watchObservedRunningTime="2026-05-31 17:31:46.692635954 +0000 UTC m=+516.288989495" May 31 17:31:48.680148 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:48.680047 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" event={"ID":"0d271c7e-4e2e-4f8e-babd-662dce648914","Type":"ContainerStarted","Data":"175d8b4e7d47574d259846b46a6dc0fc18fc03fd05d725c9d7f6598b7cbdb0bf"} May 31 17:31:48.680566 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:48.680174 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:31:49.180164 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.180101 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" podStartSLOduration=1.7358509359999998 podStartE2EDuration="4.180081613s" podCreationTimestamp="2026-05-31 17:31:45 +0000 UTC" firstStartedPulling="2026-05-31 17:31:45.504285184 +0000 UTC m=+515.100638702" lastFinishedPulling="2026-05-31 17:31:47.94851586 +0000 UTC m=+517.544869379" observedRunningTime="2026-05-31 17:31:48.717120874 +0000 UTC m=+518.313474414" watchObservedRunningTime="2026-05-31 17:31:49.180081613 +0000 UTC m=+518.776435155" May 31 17:31:49.181193 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.181173 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2556t"] May 31 17:31:49.185210 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.185189 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.188615 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.188594 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 31 17:31:49.188830 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.188815 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 31 17:31:49.189087 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.189071 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 31 17:31:49.189145 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.189088 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jtfjt\"" May 31 17:31:49.191497 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.191480 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 31 17:31:49.209759 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.209730 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2556t"] May 31 17:31:49.304058 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.304058 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.304279 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304088 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.304279 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.304279 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.304279 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd42a5e2-8b7e-4328-94d4-800bd88112b0-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.304279 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.304262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5sd\" (UniqueName: \"kubernetes.io/projected/fd42a5e2-8b7e-4328-94d4-800bd88112b0-kube-api-access-fh5sd\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.405851 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.405794 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5sd\" (UniqueName: \"kubernetes.io/projected/fd42a5e2-8b7e-4328-94d4-800bd88112b0-kube-api-access-fh5sd\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.406044 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.406027 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.406120 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.406073 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.406176 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.406118 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.406235 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.406179 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.406235 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.406203 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.406384 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.406354 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd42a5e2-8b7e-4328-94d4-800bd88112b0-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.407217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.407187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.409125 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.409066 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.409373 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.409352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd42a5e2-8b7e-4328-94d4-800bd88112b0-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.409515 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.409499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.409564 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.409531 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.417205 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.417180 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5sd\" (UniqueName: \"kubernetes.io/projected/fd42a5e2-8b7e-4328-94d4-800bd88112b0-kube-api-access-fh5sd\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.417344 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.417326 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd42a5e2-8b7e-4328-94d4-800bd88112b0-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2556t\" (UID: \"fd42a5e2-8b7e-4328-94d4-800bd88112b0\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.495393 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.495310 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:49.668178 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.668134 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2556t"] May 31 17:31:49.668537 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:31:49.668510 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd42a5e2_8b7e_4328_94d4_800bd88112b0.slice/crio-d061e54b655691d2144720fdfc44b6406500f7f7a158426b073b0241577564f3 WatchSource:0}: Error finding container d061e54b655691d2144720fdfc44b6406500f7f7a158426b073b0241577564f3: Status 404 returned error can't find the container with id d061e54b655691d2144720fdfc44b6406500f7f7a158426b073b0241577564f3 May 31 17:31:49.685905 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:49.685837 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" event={"ID":"fd42a5e2-8b7e-4328-94d4-800bd88112b0","Type":"ContainerStarted","Data":"d061e54b655691d2144720fdfc44b6406500f7f7a158426b073b0241577564f3"} May 31 17:31:52.429753 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:52.429710 2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 31 17:31:52.430127 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:52.429794 2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 31 17:31:52.699540 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:52.699446 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" event={"ID":"fd42a5e2-8b7e-4328-94d4-800bd88112b0","Type":"ContainerStarted","Data":"b9a7ef883b20a39786f2f3f73d31f0dd40f5e82d9a8f95c9017285382dc59d7e"} May 31 17:31:52.699700 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:52.699564 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:52.723661 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:52.723615 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" podStartSLOduration=0.964789015 podStartE2EDuration="3.723604377s" podCreationTimestamp="2026-05-31 17:31:49 +0000 UTC" firstStartedPulling="2026-05-31 17:31:49.670615243 +0000 UTC m=+519.266968764" lastFinishedPulling="2026-05-31 17:31:52.429430603 +0000 UTC m=+522.025784126" observedRunningTime="2026-05-31 17:31:52.720973977 +0000 UTC m=+522.317327520" watchObservedRunningTime="2026-05-31 17:31:52.723604377 +0000 UTC m=+522.319957918" May 31 17:31:53.706075 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:53.706041 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2556t" May 31 17:31:59.688353 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:31:59.688278 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-t96nb" May 31 17:32:14.660233 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:14.660203 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-dsxzn" May 31 17:32:14.663113 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:14.663095 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-87g2s" May 31 17:32:42.408847 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.408798 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9"] May 31 17:32:42.414851 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.414824 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.417569 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.417544 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 31 17:32:42.418219 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.418193 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9"] May 31 17:32:42.418632 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.418613 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r4tqj\"" May 31 17:32:42.418713 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.418653 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 31 17:32:42.525064 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.525032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.525189 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.525076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.525189 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.525158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5vq\" (UniqueName: \"kubernetes.io/projected/6e592022-2850-40d1-a01c-385de6966f4a-kube-api-access-nd5vq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.625770 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.625736 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5vq\" (UniqueName: \"kubernetes.io/projected/6e592022-2850-40d1-a01c-385de6966f4a-kube-api-access-nd5vq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.625908 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.625783 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.625979 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.625904 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.626203 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.626183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.626244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.626209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.635144 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.635121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5vq\" (UniqueName: \"kubernetes.io/projected/6e592022-2850-40d1-a01c-385de6966f4a-kube-api-access-nd5vq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.724744 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.724689 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:42.855086 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.855059 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9"] May 31 17:32:42.856395 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:32:42.856364 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e592022_2850_40d1_a01c_385de6966f4a.slice/crio-a0307443845f8afa8f7b7a74c1d8e02d5331068ce21bd0e8a96cfb914023211c WatchSource:0}: Error finding container a0307443845f8afa8f7b7a74c1d8e02d5331068ce21bd0e8a96cfb914023211c: Status 404 returned error can't find the container with id a0307443845f8afa8f7b7a74c1d8e02d5331068ce21bd0e8a96cfb914023211c May 31 17:32:42.892705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:42.892679 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" event={"ID":"6e592022-2850-40d1-a01c-385de6966f4a","Type":"ContainerStarted","Data":"a0307443845f8afa8f7b7a74c1d8e02d5331068ce21bd0e8a96cfb914023211c"} May 31 17:32:43.220504 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.220467 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh"] May 31 17:32:43.223894 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.223878 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.234504 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.234477 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh"] May 31 17:32:43.332219 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.332187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.332389 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.332255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.332389 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.332329 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22tn\" (UniqueName: \"kubernetes.io/projected/80009251-d471-43e6-aabc-f796ad06396f-kube-api-access-k22tn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.433045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.433017 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.433448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.433098 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.433448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.433127 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k22tn\" (UniqueName: \"kubernetes.io/projected/80009251-d471-43e6-aabc-f796ad06396f-kube-api-access-k22tn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.433448 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.433386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.433581 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.433457 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.441841 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.441821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22tn\" (UniqueName: \"kubernetes.io/projected/80009251-d471-43e6-aabc-f796ad06396f-kube-api-access-k22tn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.533144 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.533073 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:43.664243 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.664219 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh"] May 31 17:32:43.665836 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:32:43.665806 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80009251_d471_43e6_aabc_f796ad06396f.slice/crio-16f02ab76a49ab3088cb839604d5067d5944354ab993af8c502d4fe077ee22b1 WatchSource:0}: Error finding container 16f02ab76a49ab3088cb839604d5067d5944354ab993af8c502d4fe077ee22b1: Status 404 returned error can't find the container with id 16f02ab76a49ab3088cb839604d5067d5944354ab993af8c502d4fe077ee22b1 May 31 17:32:43.810045 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.810017 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj"] May 31 17:32:43.813573 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.813558 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:43.820883 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.820860 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj"] May 31 17:32:43.897786 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.897755 2567 generic.go:358] "Generic (PLEG): container finished" podID="80009251-d471-43e6-aabc-f796ad06396f" containerID="b9ac713f4fa5c8d7117617eef0bc2068f9010bc19dd64335678f851ed57d6be2" exitCode=0 May 31 17:32:43.897892 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.897842 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" event={"ID":"80009251-d471-43e6-aabc-f796ad06396f","Type":"ContainerDied","Data":"b9ac713f4fa5c8d7117617eef0bc2068f9010bc19dd64335678f851ed57d6be2"} May 31 17:32:43.897892 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.897876 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" event={"ID":"80009251-d471-43e6-aabc-f796ad06396f","Type":"ContainerStarted","Data":"16f02ab76a49ab3088cb839604d5067d5944354ab993af8c502d4fe077ee22b1"} May 31 17:32:43.899437 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.899416 2567 generic.go:358] "Generic (PLEG): container finished" podID="6e592022-2850-40d1-a01c-385de6966f4a" containerID="5e2f4683a7adf6c4fa8b90a2a0ab6c7f4039dae94b7402d95e189aa15489c778" exitCode=0 May 31 17:32:43.899517 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.899479 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" event={"ID":"6e592022-2850-40d1-a01c-385de6966f4a","Type":"ContainerDied","Data":"5e2f4683a7adf6c4fa8b90a2a0ab6c7f4039dae94b7402d95e189aa15489c778"} May 31 17:32:43.938338 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.938308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8xn5\" (UniqueName: \"kubernetes.io/projected/32ec60b9-7842-4b41-a9d1-2397792a09a0-kube-api-access-h8xn5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:43.938440 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.938343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:43.938440 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:43.938363 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.038830 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.038802 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8xn5\" (UniqueName: \"kubernetes.io/projected/32ec60b9-7842-4b41-a9d1-2397792a09a0-kube-api-access-h8xn5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.038830 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.038832 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.038980 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.038850 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.039173 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.039156 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.039213 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.039186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.047491 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.047464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8xn5\" (UniqueName: \"kubernetes.io/projected/32ec60b9-7842-4b41-a9d1-2397792a09a0-kube-api-access-h8xn5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.143694 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.143639 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:44.217844 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.217800 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn"] May 31 17:32:44.223351 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.223325 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.232123 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.227696 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn"] May 31 17:32:44.280658 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.280571 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj"] May 31 17:32:44.282752 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:32:44.282729 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ec60b9_7842_4b41_a9d1_2397792a09a0.slice/crio-11177326c6e0d374ce95f82fd49f1ec0cc671a711baa0e1d40795fdaf7fc1380 WatchSource:0}: Error finding container 11177326c6e0d374ce95f82fd49f1ec0cc671a711baa0e1d40795fdaf7fc1380: Status 404 returned error can't find the container with id 11177326c6e0d374ce95f82fd49f1ec0cc671a711baa0e1d40795fdaf7fc1380 May 31 17:32:44.341734 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.341707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.341829 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.341774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.341829 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.341820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfrkf\" (UniqueName: \"kubernetes.io/projected/a751ed5a-c876-4bc7-946d-9a3dd1c05358-kube-api-access-jfrkf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.443087 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.443028 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.443087 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.443082 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.443508 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.443111 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfrkf\" (UniqueName: \"kubernetes.io/projected/a751ed5a-c876-4bc7-946d-9a3dd1c05358-kube-api-access-jfrkf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.443508 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.443359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.443508 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.443438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.451046 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.451025 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfrkf\" (UniqueName: \"kubernetes.io/projected/a751ed5a-c876-4bc7-946d-9a3dd1c05358-kube-api-access-jfrkf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.535085 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.535055 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:44.906603 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.906561 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" event={"ID":"80009251-d471-43e6-aabc-f796ad06396f","Type":"ContainerStarted","Data":"192cc809adf1a68699615cb0ba0d2bfd6d8c31d01e0afe0048b9dcd31ed921c4"} May 31 17:32:44.908616 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.908591 2567 generic.go:358] "Generic (PLEG): container finished" podID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerID="36a4aa65f23567c5a89baa1fc3f927e4fe55a8a8cff4ac0861cdca79ddd80abb" exitCode=0 May 31 17:32:44.908742 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.908668 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" event={"ID":"32ec60b9-7842-4b41-a9d1-2397792a09a0","Type":"ContainerDied","Data":"36a4aa65f23567c5a89baa1fc3f927e4fe55a8a8cff4ac0861cdca79ddd80abb"} May 31 17:32:44.908742 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.908703 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" event={"ID":"32ec60b9-7842-4b41-a9d1-2397792a09a0","Type":"ContainerStarted","Data":"11177326c6e0d374ce95f82fd49f1ec0cc671a711baa0e1d40795fdaf7fc1380"} May 31 17:32:44.911141 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.911112 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" event={"ID":"6e592022-2850-40d1-a01c-385de6966f4a","Type":"ContainerStarted","Data":"38cfb9784f638b22ed658832d48acfd4588cbb8989ef0b3c5451ea449053fee1"} May 31 17:32:44.929693 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:44.929670 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn"] May 31 17:32:44.971855 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:32:44.971828 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda751ed5a_c876_4bc7_946d_9a3dd1c05358.slice/crio-0a33bb2264de0f23f35c639cf3ec947f300889f1f88491d5389bd4d4aa2f4e59 WatchSource:0}: Error finding container 0a33bb2264de0f23f35c639cf3ec947f300889f1f88491d5389bd4d4aa2f4e59: Status 404 returned error can't find the container with id 0a33bb2264de0f23f35c639cf3ec947f300889f1f88491d5389bd4d4aa2f4e59 May 31 17:32:45.916676 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.916600 2567 generic.go:358] "Generic (PLEG): container finished" podID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerID="9a0e6722701ce2537549375ac2fa42d1935b73788660abda525c54dddcba6b2b" exitCode=0 May 31 17:32:45.917095 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.916680 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" event={"ID":"a751ed5a-c876-4bc7-946d-9a3dd1c05358","Type":"ContainerDied","Data":"9a0e6722701ce2537549375ac2fa42d1935b73788660abda525c54dddcba6b2b"} May 31 17:32:45.917095 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.916715 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" event={"ID":"a751ed5a-c876-4bc7-946d-9a3dd1c05358","Type":"ContainerStarted","Data":"0a33bb2264de0f23f35c639cf3ec947f300889f1f88491d5389bd4d4aa2f4e59"} May 31 17:32:45.918614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.918588 2567 generic.go:358] "Generic (PLEG): container finished" podID="80009251-d471-43e6-aabc-f796ad06396f" containerID="192cc809adf1a68699615cb0ba0d2bfd6d8c31d01e0afe0048b9dcd31ed921c4" exitCode=0 May 31 17:32:45.918724 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.918667 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" event={"ID":"80009251-d471-43e6-aabc-f796ad06396f","Type":"ContainerDied","Data":"192cc809adf1a68699615cb0ba0d2bfd6d8c31d01e0afe0048b9dcd31ed921c4"} May 31 17:32:45.920766 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.920745 2567 generic.go:358] "Generic (PLEG): container finished" podID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerID="e660eaa2527256ad6599d186ece174fbd29e782c217d76c83ffa69ddcfd62370" exitCode=0 May 31 17:32:45.921060 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.920836 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" event={"ID":"32ec60b9-7842-4b41-a9d1-2397792a09a0","Type":"ContainerDied","Data":"e660eaa2527256ad6599d186ece174fbd29e782c217d76c83ffa69ddcfd62370"} May 31 17:32:45.922861 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.922839 2567 generic.go:358] "Generic (PLEG): container finished" podID="6e592022-2850-40d1-a01c-385de6966f4a" containerID="38cfb9784f638b22ed658832d48acfd4588cbb8989ef0b3c5451ea449053fee1" exitCode=0 May 31 17:32:45.922968 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:45.922871 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" event={"ID":"6e592022-2850-40d1-a01c-385de6966f4a","Type":"ContainerDied","Data":"38cfb9784f638b22ed658832d48acfd4588cbb8989ef0b3c5451ea449053fee1"} May 31 17:32:46.931320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.931227 2567 generic.go:358] "Generic (PLEG): container finished" podID="80009251-d471-43e6-aabc-f796ad06396f" containerID="88cb294ef4f44c9655311937ce0f42054fba19205a5147d3e7ae8691af458c89" exitCode=0 May 31 17:32:46.931320 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.931307 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" event={"ID":"80009251-d471-43e6-aabc-f796ad06396f","Type":"ContainerDied","Data":"88cb294ef4f44c9655311937ce0f42054fba19205a5147d3e7ae8691af458c89"} May 31 17:32:46.933205 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.933184 2567 generic.go:358] "Generic (PLEG): container finished" podID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerID="761afefaeb9e75df04cfdc202450712e12eb8b5644223ab715e78633c8b7b380" exitCode=0 May 31 17:32:46.933309 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.933254 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" event={"ID":"32ec60b9-7842-4b41-a9d1-2397792a09a0","Type":"ContainerDied","Data":"761afefaeb9e75df04cfdc202450712e12eb8b5644223ab715e78633c8b7b380"} May 31 17:32:46.934996 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.934966 2567 generic.go:358] "Generic (PLEG): container finished" podID="6e592022-2850-40d1-a01c-385de6966f4a" containerID="caea2357568cd51fe9a21a4794a0024b116e49fc9f737c8f49ba333c02125476" exitCode=0 May 31 17:32:46.935091 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.935037 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" event={"ID":"6e592022-2850-40d1-a01c-385de6966f4a","Type":"ContainerDied","Data":"caea2357568cd51fe9a21a4794a0024b116e49fc9f737c8f49ba333c02125476"} May 31 17:32:46.936578 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.936560 2567 generic.go:358] "Generic (PLEG): container finished" podID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerID="943dfdcc4998e131d35818651454b56c481e09ab2a5183bdac1758857bef0f16" exitCode=0 May 31 17:32:46.936672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:46.936604 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" event={"ID":"a751ed5a-c876-4bc7-946d-9a3dd1c05358","Type":"ContainerDied","Data":"943dfdcc4998e131d35818651454b56c481e09ab2a5183bdac1758857bef0f16"} May 31 17:32:47.942849 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:47.942816 2567 generic.go:358] "Generic (PLEG): container finished" podID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerID="89ab5d2f4b17a4a7466ad4bf7e3fcb5549697541f82ecdb2db9370bc5c703ec0" exitCode=0 May 31 17:32:47.943277 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:47.942907 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" event={"ID":"a751ed5a-c876-4bc7-946d-9a3dd1c05358","Type":"ContainerDied","Data":"89ab5d2f4b17a4a7466ad4bf7e3fcb5549697541f82ecdb2db9370bc5c703ec0"} May 31 17:32:48.096832 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.096799 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:48.130340 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.130319 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:48.133880 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.133862 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:48.177155 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.177130 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k22tn\" (UniqueName: \"kubernetes.io/projected/80009251-d471-43e6-aabc-f796ad06396f-kube-api-access-k22tn\") pod \"80009251-d471-43e6-aabc-f796ad06396f\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " May 31 17:32:48.177282 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.177206 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-bundle\") pod \"80009251-d471-43e6-aabc-f796ad06396f\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " May 31 17:32:48.177282 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.177242 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-util\") pod \"80009251-d471-43e6-aabc-f796ad06396f\" (UID: \"80009251-d471-43e6-aabc-f796ad06396f\") " May 31 17:32:48.177721 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.177691 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-bundle" (OuterVolumeSpecName: "bundle") pod "80009251-d471-43e6-aabc-f796ad06396f" (UID: "80009251-d471-43e6-aabc-f796ad06396f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:48.179571 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.179547 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80009251-d471-43e6-aabc-f796ad06396f-kube-api-access-k22tn" (OuterVolumeSpecName: "kube-api-access-k22tn") pod "80009251-d471-43e6-aabc-f796ad06396f" (UID: "80009251-d471-43e6-aabc-f796ad06396f"). InnerVolumeSpecName "kube-api-access-k22tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:32:48.182636 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.182605 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-util" (OuterVolumeSpecName: "util") pod "80009251-d471-43e6-aabc-f796ad06396f" (UID: "80009251-d471-43e6-aabc-f796ad06396f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:48.277855 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.277798 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-util\") pod \"32ec60b9-7842-4b41-a9d1-2397792a09a0\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " May 31 17:32:48.277855 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.277833 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-util\") pod \"6e592022-2850-40d1-a01c-385de6966f4a\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " May 31 17:32:48.277855 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.277852 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8xn5\" (UniqueName: \"kubernetes.io/projected/32ec60b9-7842-4b41-a9d1-2397792a09a0-kube-api-access-h8xn5\") pod \"32ec60b9-7842-4b41-a9d1-2397792a09a0\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " May 31 17:32:48.278099 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.277896 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-bundle\") pod \"6e592022-2850-40d1-a01c-385de6966f4a\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " May 31 17:32:48.278099 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.277948 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-bundle\") pod \"32ec60b9-7842-4b41-a9d1-2397792a09a0\" (UID: \"32ec60b9-7842-4b41-a9d1-2397792a09a0\") " May 31 17:32:48.278099 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.277972 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd5vq\" (UniqueName: \"kubernetes.io/projected/6e592022-2850-40d1-a01c-385de6966f4a-kube-api-access-nd5vq\") pod \"6e592022-2850-40d1-a01c-385de6966f4a\" (UID: \"6e592022-2850-40d1-a01c-385de6966f4a\") " May 31 17:32:48.278256 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.278174 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.278256 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.278191 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80009251-d471-43e6-aabc-f796ad06396f-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.278256 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.278205 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k22tn\" (UniqueName: \"kubernetes.io/projected/80009251-d471-43e6-aabc-f796ad06396f-kube-api-access-k22tn\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.278432 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.278407 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-bundle" (OuterVolumeSpecName: "bundle") pod "32ec60b9-7842-4b41-a9d1-2397792a09a0" (UID: "32ec60b9-7842-4b41-a9d1-2397792a09a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:48.278486 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.278423 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-bundle" (OuterVolumeSpecName: "bundle") pod "6e592022-2850-40d1-a01c-385de6966f4a" (UID: "6e592022-2850-40d1-a01c-385de6966f4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:48.280122 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.280100 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ec60b9-7842-4b41-a9d1-2397792a09a0-kube-api-access-h8xn5" (OuterVolumeSpecName: "kube-api-access-h8xn5") pod "32ec60b9-7842-4b41-a9d1-2397792a09a0" (UID: "32ec60b9-7842-4b41-a9d1-2397792a09a0"). InnerVolumeSpecName "kube-api-access-h8xn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:32:48.280234 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.280211 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e592022-2850-40d1-a01c-385de6966f4a-kube-api-access-nd5vq" (OuterVolumeSpecName: "kube-api-access-nd5vq") pod "6e592022-2850-40d1-a01c-385de6966f4a" (UID: "6e592022-2850-40d1-a01c-385de6966f4a"). InnerVolumeSpecName "kube-api-access-nd5vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:32:48.283153 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.283131 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-util" (OuterVolumeSpecName: "util") pod "6e592022-2850-40d1-a01c-385de6966f4a" (UID: "6e592022-2850-40d1-a01c-385de6966f4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:48.283618 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.283599 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-util" (OuterVolumeSpecName: "util") pod "32ec60b9-7842-4b41-a9d1-2397792a09a0" (UID: "32ec60b9-7842-4b41-a9d1-2397792a09a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:48.378772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.378750 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.378772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.378774 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.378970 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.378784 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd5vq\" (UniqueName: \"kubernetes.io/projected/6e592022-2850-40d1-a01c-385de6966f4a-kube-api-access-nd5vq\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.378970 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.378794 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32ec60b9-7842-4b41-a9d1-2397792a09a0-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.378970 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.378803 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e592022-2850-40d1-a01c-385de6966f4a-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.378970 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.378811 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8xn5\" (UniqueName: \"kubernetes.io/projected/32ec60b9-7842-4b41-a9d1-2397792a09a0-kube-api-access-h8xn5\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:48.948468 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.948434 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" event={"ID":"32ec60b9-7842-4b41-a9d1-2397792a09a0","Type":"ContainerDied","Data":"11177326c6e0d374ce95f82fd49f1ec0cc671a711baa0e1d40795fdaf7fc1380"} May 31 17:32:48.948468 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.948459 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj" May 31 17:32:48.948977 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.948466 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11177326c6e0d374ce95f82fd49f1ec0cc671a711baa0e1d40795fdaf7fc1380" May 31 17:32:48.950495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.950459 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" event={"ID":"6e592022-2850-40d1-a01c-385de6966f4a","Type":"ContainerDied","Data":"a0307443845f8afa8f7b7a74c1d8e02d5331068ce21bd0e8a96cfb914023211c"} May 31 17:32:48.950495 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.950489 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0307443845f8afa8f7b7a74c1d8e02d5331068ce21bd0e8a96cfb914023211c" May 31 17:32:48.950661 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.950489 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9" May 31 17:32:48.952688 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.952667 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" May 31 17:32:48.952864 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.952839 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh" event={"ID":"80009251-d471-43e6-aabc-f796ad06396f","Type":"ContainerDied","Data":"16f02ab76a49ab3088cb839604d5067d5944354ab993af8c502d4fe077ee22b1"} May 31 17:32:48.952962 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:48.952870 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16f02ab76a49ab3088cb839604d5067d5944354ab993af8c502d4fe077ee22b1" May 31 17:32:49.087212 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.087192 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:49.185383 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.185353 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-util\") pod \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " May 31 17:32:49.185514 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.185403 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfrkf\" (UniqueName: \"kubernetes.io/projected/a751ed5a-c876-4bc7-946d-9a3dd1c05358-kube-api-access-jfrkf\") pod \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " May 31 17:32:49.185514 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.185463 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-bundle\") pod \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\" (UID: \"a751ed5a-c876-4bc7-946d-9a3dd1c05358\") " May 31 17:32:49.186100 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.186059 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-bundle" (OuterVolumeSpecName: "bundle") pod "a751ed5a-c876-4bc7-946d-9a3dd1c05358" (UID: "a751ed5a-c876-4bc7-946d-9a3dd1c05358"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:49.187598 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.187572 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a751ed5a-c876-4bc7-946d-9a3dd1c05358-kube-api-access-jfrkf" (OuterVolumeSpecName: "kube-api-access-jfrkf") pod "a751ed5a-c876-4bc7-946d-9a3dd1c05358" (UID: "a751ed5a-c876-4bc7-946d-9a3dd1c05358"). InnerVolumeSpecName "kube-api-access-jfrkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:32:49.190987 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.190964 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-util" (OuterVolumeSpecName: "util") pod "a751ed5a-c876-4bc7-946d-9a3dd1c05358" (UID: "a751ed5a-c876-4bc7-946d-9a3dd1c05358"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:32:49.286278 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.286222 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfrkf\" (UniqueName: \"kubernetes.io/projected/a751ed5a-c876-4bc7-946d-9a3dd1c05358-kube-api-access-jfrkf\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:49.286278 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.286247 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:49.286278 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.286256 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a751ed5a-c876-4bc7-946d-9a3dd1c05358-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:32:49.957604 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.957569 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" event={"ID":"a751ed5a-c876-4bc7-946d-9a3dd1c05358","Type":"ContainerDied","Data":"0a33bb2264de0f23f35c639cf3ec947f300889f1f88491d5389bd4d4aa2f4e59"} May 31 17:32:49.958001 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.957612 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a33bb2264de0f23f35c639cf3ec947f300889f1f88491d5389bd4d4aa2f4e59" May 31 17:32:49.958001 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:49.957583 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn" May 31 17:32:53.865864 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.865832 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-657694c47b-9vfcb"] May 31 17:32:53.866417 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866398 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="util" May 31 17:32:53.866465 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866422 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="util" May 31 17:32:53.866465 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866439 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="util" May 31 17:32:53.866465 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866447 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="util" May 31 17:32:53.866465 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866457 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="util" May 31 17:32:53.866465 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866466 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="util" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866478 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866487 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866496 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="pull" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866504 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="pull" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866511 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="pull" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866519 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="pull" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866531 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866538 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866554 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866562 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866578 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="util" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866585 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="util" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866599 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="pull" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866606 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="pull" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866619 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="extract" May 31 17:32:53.866623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866627 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="extract" May 31 17:32:53.867112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866636 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="pull" May 31 17:32:53.867112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866644 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="pull" May 31 17:32:53.867112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866730 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e592022-2850-40d1-a01c-385de6966f4a" containerName="extract" May 31 17:32:53.867112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866746 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="80009251-d471-43e6-aabc-f796ad06396f" containerName="extract" May 31 17:32:53.867112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866758 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="a751ed5a-c876-4bc7-946d-9a3dd1c05358" containerName="extract" May 31 17:32:53.867112 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.866769 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="32ec60b9-7842-4b41-a9d1-2397792a09a0" containerName="extract" May 31 17:32:53.872487 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.872467 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:53.897276 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:53.897239 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657694c47b-9vfcb"] May 31 17:32:54.023247 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2phn\" (UniqueName: \"kubernetes.io/projected/6d3bede4-672a-473a-b603-1e126eaa0ead-kube-api-access-f2phn\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.023387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-service-ca\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.023387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-oauth-serving-cert\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.023387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-console-config\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.023582 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d3bede4-672a-473a-b603-1e126eaa0ead-console-oauth-config\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.023705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-trusted-ca-bundle\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.023705 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.023678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d3bede4-672a-473a-b603-1e126eaa0ead-console-serving-cert\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124188 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124090 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d3bede4-672a-473a-b603-1e126eaa0ead-console-oauth-config\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124188 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124146 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-trusted-ca-bundle\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124188 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124181 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d3bede4-672a-473a-b603-1e126eaa0ead-console-serving-cert\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124459 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124228 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2phn\" (UniqueName: \"kubernetes.io/projected/6d3bede4-672a-473a-b603-1e126eaa0ead-kube-api-access-f2phn\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124459 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124252 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-service-ca\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124459 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124285 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-oauth-serving-cert\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.124459 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.124335 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-console-config\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.125101 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.125073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-service-ca\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.125206 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.125118 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-oauth-serving-cert\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.125206 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.125125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-console-config\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.125206 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.125190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d3bede4-672a-473a-b603-1e126eaa0ead-trusted-ca-bundle\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.126766 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.126747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d3bede4-672a-473a-b603-1e126eaa0ead-console-serving-cert\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.126843 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.126781 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d3bede4-672a-473a-b603-1e126eaa0ead-console-oauth-config\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.133446 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.133423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2phn\" (UniqueName: \"kubernetes.io/projected/6d3bede4-672a-473a-b603-1e126eaa0ead-kube-api-access-f2phn\") pod \"console-657694c47b-9vfcb\" (UID: \"6d3bede4-672a-473a-b603-1e126eaa0ead\") " pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.181961 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.181916 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657694c47b-9vfcb" May 31 17:32:54.314693 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.314659 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657694c47b-9vfcb"] May 31 17:32:54.315932 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:32:54.315891 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3bede4_672a_473a_b603_1e126eaa0ead.slice/crio-1b5444c4d45ef2d7f92a74ae03e6cd50e1536fd832688debad03bf189b24dae3 WatchSource:0}: Error finding container 1b5444c4d45ef2d7f92a74ae03e6cd50e1536fd832688debad03bf189b24dae3: Status 404 returned error can't find the container with id 1b5444c4d45ef2d7f92a74ae03e6cd50e1536fd832688debad03bf189b24dae3 May 31 17:32:54.979650 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.979612 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657694c47b-9vfcb" event={"ID":"6d3bede4-672a-473a-b603-1e126eaa0ead","Type":"ContainerStarted","Data":"7c76cc0f6ee697ef96b9eb45210d8cad52909f7f1170d9582203be963fa6c0a0"} May 31 17:32:54.979650 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:54.979652 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657694c47b-9vfcb" event={"ID":"6d3bede4-672a-473a-b603-1e126eaa0ead","Type":"ContainerStarted","Data":"1b5444c4d45ef2d7f92a74ae03e6cd50e1536fd832688debad03bf189b24dae3"} May 31 17:32:55.005763 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:32:55.005716 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-657694c47b-9vfcb" podStartSLOduration=2.005703622 podStartE2EDuration="2.005703622s" podCreationTimestamp="2026-05-31 17:32:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:32:55.002268289 +0000 UTC m=+584.598621829" watchObservedRunningTime="2026-05-31 17:32:55.005703622 +0000 UTC m=+584.602057163" May 31 17:33:04.182576 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:04.182541 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657694c47b-9vfcb" May 31 17:33:04.182576 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:04.182586 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657694c47b-9vfcb" May 31 17:33:04.187273 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:04.187249 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657694c47b-9vfcb" May 31 17:33:05.023675 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.023645 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657694c47b-9vfcb" May 31 17:33:05.088619 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.088583 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-569dd475-vh9gk"] May 31 17:33:05.857083 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.857049 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp"] May 31 17:33:05.862228 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.862209 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:05.865209 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.865188 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8g6tt\"" May 31 17:33:05.866304 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.866286 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 31 17:33:05.866392 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.866323 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 31 17:33:05.874056 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:05.874033 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp"] May 31 17:33:06.021909 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:06.021881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dbnw\" (UniqueName: \"kubernetes.io/projected/75b54f41-ee03-4186-b122-22cb2aa7a40b-kube-api-access-5dbnw\") pod \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" (UID: \"75b54f41-ee03-4186-b122-22cb2aa7a40b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:06.123093 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:06.123010 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dbnw\" (UniqueName: \"kubernetes.io/projected/75b54f41-ee03-4186-b122-22cb2aa7a40b-kube-api-access-5dbnw\") pod \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" (UID: \"75b54f41-ee03-4186-b122-22cb2aa7a40b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:06.135630 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:06.135604 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dbnw\" (UniqueName: \"kubernetes.io/projected/75b54f41-ee03-4186-b122-22cb2aa7a40b-kube-api-access-5dbnw\") pod \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" (UID: \"75b54f41-ee03-4186-b122-22cb2aa7a40b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:06.172961 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:06.172913 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:06.308124 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:06.308085 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp"] May 31 17:33:06.309610 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:33:06.309580 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b54f41_ee03_4186_b122_22cb2aa7a40b.slice/crio-c5bf2bed02fc79cc59508082ab4530953855546671f7db3f77d2a290a3d38d93 WatchSource:0}: Error finding container c5bf2bed02fc79cc59508082ab4530953855546671f7db3f77d2a290a3d38d93: Status 404 returned error can't find the container with id c5bf2bed02fc79cc59508082ab4530953855546671f7db3f77d2a290a3d38d93 May 31 17:33:07.030719 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:07.030670 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" event={"ID":"75b54f41-ee03-4186-b122-22cb2aa7a40b","Type":"ContainerStarted","Data":"c5bf2bed02fc79cc59508082ab4530953855546671f7db3f77d2a290a3d38d93"} May 31 17:33:09.042651 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:09.042609 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" event={"ID":"75b54f41-ee03-4186-b122-22cb2aa7a40b","Type":"ContainerStarted","Data":"67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c"} May 31 17:33:09.043038 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:09.042739 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:09.078407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:09.078356 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" podStartSLOduration=2.107526195 podStartE2EDuration="4.07834367s" podCreationTimestamp="2026-05-31 17:33:05 +0000 UTC" firstStartedPulling="2026-05-31 17:33:06.311629303 +0000 UTC m=+595.907982823" lastFinishedPulling="2026-05-31 17:33:08.282446776 +0000 UTC m=+597.878800298" observedRunningTime="2026-05-31 17:33:09.074710277 +0000 UTC m=+598.671063817" watchObservedRunningTime="2026-05-31 17:33:09.07834367 +0000 UTC m=+598.674697213" May 31 17:33:10.887865 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:10.887828 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:33:10.888292 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:10.887917 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:33:19.381519 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.381483 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp"] May 31 17:33:19.385781 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.381782 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" containerName="manager" containerID="cri-o://67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c" gracePeriod=2 May 31 17:33:19.385781 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.384107 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:19.392769 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.392732 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:19.395666 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.395642 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp"] May 31 17:33:19.412418 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.412392 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29"] May 31 17:33:19.412777 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.412765 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" containerName="manager" May 31 17:33:19.412827 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.412779 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" containerName="manager" May 31 17:33:19.412867 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.412860 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" containerName="manager" May 31 17:33:19.416180 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.416160 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:19.435474 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.435449 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29"] May 31 17:33:19.452948 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.452886 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:19.535298 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.535271 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwb9\" (UniqueName: \"kubernetes.io/projected/07294c19-ce6d-451c-b366-ac82a0a59422-kube-api-access-dmwb9\") pod \"limitador-operator-controller-manager-85c4996f8c-zpc29\" (UID: \"07294c19-ce6d-451c-b366-ac82a0a59422\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:19.615387 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.615362 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:19.617686 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.617662 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:19.636190 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.636139 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwb9\" (UniqueName: \"kubernetes.io/projected/07294c19-ce6d-451c-b366-ac82a0a59422-kube-api-access-dmwb9\") pod \"limitador-operator-controller-manager-85c4996f8c-zpc29\" (UID: \"07294c19-ce6d-451c-b366-ac82a0a59422\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:19.654762 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.654734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwb9\" (UniqueName: \"kubernetes.io/projected/07294c19-ce6d-451c-b366-ac82a0a59422-kube-api-access-dmwb9\") pod \"limitador-operator-controller-manager-85c4996f8c-zpc29\" (UID: \"07294c19-ce6d-451c-b366-ac82a0a59422\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:19.737301 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.737278 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dbnw\" (UniqueName: \"kubernetes.io/projected/75b54f41-ee03-4186-b122-22cb2aa7a40b-kube-api-access-5dbnw\") pod \"75b54f41-ee03-4186-b122-22cb2aa7a40b\" (UID: \"75b54f41-ee03-4186-b122-22cb2aa7a40b\") " May 31 17:33:19.739363 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.739333 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b54f41-ee03-4186-b122-22cb2aa7a40b-kube-api-access-5dbnw" (OuterVolumeSpecName: "kube-api-access-5dbnw") pod "75b54f41-ee03-4186-b122-22cb2aa7a40b" (UID: "75b54f41-ee03-4186-b122-22cb2aa7a40b"). InnerVolumeSpecName "kube-api-access-5dbnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:33:19.768568 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.768545 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:19.838752 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.838723 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dbnw\" (UniqueName: \"kubernetes.io/projected/75b54f41-ee03-4186-b122-22cb2aa7a40b-kube-api-access-5dbnw\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:19.899255 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:19.899230 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29"] May 31 17:33:19.900084 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:33:19.900057 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07294c19_ce6d_451c_b366_ac82a0a59422.slice/crio-74bb8c2cb99c79cec94ef843f877935b3dcd917cb75746e37975fa1d401116ab WatchSource:0}: Error finding container 74bb8c2cb99c79cec94ef843f877935b3dcd917cb75746e37975fa1d401116ab: Status 404 returned error can't find the container with id 74bb8c2cb99c79cec94ef843f877935b3dcd917cb75746e37975fa1d401116ab May 31 17:33:20.084639 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.084606 2567 generic.go:358] "Generic (PLEG): container finished" podID="75b54f41-ee03-4186-b122-22cb2aa7a40b" containerID="67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c" exitCode=0 May 31 17:33:20.084822 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.084647 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" May 31 17:33:20.084822 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.084707 2567 scope.go:117] "RemoveContainer" containerID="67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c" May 31 17:33:20.086520 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.086497 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" event={"ID":"07294c19-ce6d-451c-b366-ac82a0a59422","Type":"ContainerStarted","Data":"2867e0045e385ca7584bce6201b7655e1685004b6c1163917754a6bc9358dfd3"} May 31 17:33:20.086635 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.086530 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" event={"ID":"07294c19-ce6d-451c-b366-ac82a0a59422","Type":"ContainerStarted","Data":"74bb8c2cb99c79cec94ef843f877935b3dcd917cb75746e37975fa1d401116ab"} May 31 17:33:20.086702 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.086644 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:20.087240 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.087217 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:20.094773 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.094754 2567 scope.go:117] "RemoveContainer" containerID="67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c" May 31 17:33:20.095075 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:33:20.095057 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c\": container with ID starting with 67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c not found: ID does not exist" containerID="67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c" May 31 17:33:20.095143 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.095082 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c"} err="failed to get container status \"67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c\": rpc error: code = NotFound desc = could not find container \"67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c\": container with ID starting with 67057a3513b20c76bdc172028c0adb07272039ad718121d599c52c3e53f0629c not found: ID does not exist" May 31 17:33:20.112182 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.112156 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:20.113945 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.113909 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:20.947660 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.947626 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" path="/var/lib/kubelet/pods/75b54f41-ee03-4186-b122-22cb2aa7a40b/volumes" May 31 17:33:20.948023 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:20.947859 2567 status_manager.go:895] "Failed to get status for pod" podUID="75b54f41-ee03-4186-b122-22cb2aa7a40b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n7zzp" err="pods \"limitador-operator-controller-manager-85c4996f8c-n7zzp\" is forbidden: User \"system:node:ip-10-0-143-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-182.ec2.internal' and this object" May 31 17:33:30.116686 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.116576 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-569dd475-vh9gk" podUID="da355b69-152a-4375-ac2f-085753f27595" containerName="console" containerID="cri-o://04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f" gracePeriod=15 May 31 17:33:30.362343 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.362320 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-569dd475-vh9gk_da355b69-152a-4375-ac2f-085753f27595/console/0.log" May 31 17:33:30.362456 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.362394 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd475-vh9gk" May 31 17:33:30.386125 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.386039 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" podStartSLOduration=11.38602171 podStartE2EDuration="11.38602171s" podCreationTimestamp="2026-05-31 17:33:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 17:33:20.110125779 +0000 UTC m=+609.706479321" watchObservedRunningTime="2026-05-31 17:33:30.38602171 +0000 UTC m=+619.982375252" May 31 17:33:30.423715 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423689 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-trusted-ca-bundle\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.423845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423733 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-oauth-serving-cert\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.423845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423750 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-oauth-config\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.423845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423790 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-service-ca\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.423845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423831 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bmtq\" (UniqueName: \"kubernetes.io/projected/da355b69-152a-4375-ac2f-085753f27595-kube-api-access-9bmtq\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.424078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423859 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-console-config\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.424078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.423905 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-serving-cert\") pod \"da355b69-152a-4375-ac2f-085753f27595\" (UID: \"da355b69-152a-4375-ac2f-085753f27595\") " May 31 17:33:30.424270 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.424246 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:33:30.424317 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.424253 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:33:30.424356 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.424314 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-service-ca" (OuterVolumeSpecName: "service-ca") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:33:30.424487 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.424466 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-console-config" (OuterVolumeSpecName: "console-config") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 31 17:33:30.426298 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.426276 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:33:30.426555 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.426533 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 31 17:33:30.426624 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.426561 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da355b69-152a-4375-ac2f-085753f27595-kube-api-access-9bmtq" (OuterVolumeSpecName: "kube-api-access-9bmtq") pod "da355b69-152a-4375-ac2f-085753f27595" (UID: "da355b69-152a-4375-ac2f-085753f27595"). InnerVolumeSpecName "kube-api-access-9bmtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:33:30.525266 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525238 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-service-ca\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:30.525266 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525263 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bmtq\" (UniqueName: \"kubernetes.io/projected/da355b69-152a-4375-ac2f-085753f27595-kube-api-access-9bmtq\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:30.525407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525279 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-console-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:30.525407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525293 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:30.525407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525305 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-trusted-ca-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:30.525407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525318 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da355b69-152a-4375-ac2f-085753f27595-oauth-serving-cert\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:30.525407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:30.525332 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da355b69-152a-4375-ac2f-085753f27595-console-oauth-config\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:33:31.093553 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.093527 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zpc29" May 31 17:33:31.130158 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.130131 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-569dd475-vh9gk_da355b69-152a-4375-ac2f-085753f27595/console/0.log" May 31 17:33:31.130577 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.130169 2567 generic.go:358] "Generic (PLEG): container finished" podID="da355b69-152a-4375-ac2f-085753f27595" containerID="04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f" exitCode=2 May 31 17:33:31.130577 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.130236 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd475-vh9gk" event={"ID":"da355b69-152a-4375-ac2f-085753f27595","Type":"ContainerDied","Data":"04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f"} May 31 17:33:31.130577 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.130278 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd475-vh9gk" event={"ID":"da355b69-152a-4375-ac2f-085753f27595","Type":"ContainerDied","Data":"2c99db8df78c71ee871f48382dfc6aa167744b44aadf010c21c05919d5be689d"} May 31 17:33:31.130577 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.130302 2567 scope.go:117] "RemoveContainer" containerID="04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f" May 31 17:33:31.130577 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.130251 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd475-vh9gk" May 31 17:33:31.140635 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.140618 2567 scope.go:117] "RemoveContainer" containerID="04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f" May 31 17:33:31.140911 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:33:31.140892 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f\": container with ID starting with 04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f not found: ID does not exist" containerID="04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f" May 31 17:33:31.140994 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.140940 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f"} err="failed to get container status \"04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f\": rpc error: code = NotFound desc = could not find container \"04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f\": container with ID starting with 04220d01156d9625ec7d3acd7a31289f7fbb06a1310ab217201f799eeb02001f not found: ID does not exist" May 31 17:33:31.154859 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.154835 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-569dd475-vh9gk"] May 31 17:33:31.165733 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:31.165710 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-569dd475-vh9gk"] May 31 17:33:32.946963 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:33:32.946911 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da355b69-152a-4375-ac2f-085753f27595" path="/var/lib/kubelet/pods/da355b69-152a-4375-ac2f-085753f27595/volumes" May 31 17:34:04.438727 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.438691 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:34:04.439225 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.439152 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da355b69-152a-4375-ac2f-085753f27595" containerName="console" May 31 17:34:04.439225 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.439171 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="da355b69-152a-4375-ac2f-085753f27595" containerName="console" May 31 17:34:04.439351 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.439260 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="da355b69-152a-4375-ac2f-085753f27595" containerName="console" May 31 17:34:04.442084 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.442068 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.444799 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.444769 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 31 17:34:04.444917 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.444897 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r4tqj\"" May 31 17:34:04.451002 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.450953 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:34:04.474417 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.474393 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:34:04.593775 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.593747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b3637afc-5a5e-467a-a6ba-26fc55c35b30-config-file\") pod \"limitador-limitador-78c99df468-5lk8l\" (UID: \"b3637afc-5a5e-467a-a6ba-26fc55c35b30\") " pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.593906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.593815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7jws\" (UniqueName: \"kubernetes.io/projected/b3637afc-5a5e-467a-a6ba-26fc55c35b30-kube-api-access-v7jws\") pod \"limitador-limitador-78c99df468-5lk8l\" (UID: \"b3637afc-5a5e-467a-a6ba-26fc55c35b30\") " pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.694759 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.694695 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b3637afc-5a5e-467a-a6ba-26fc55c35b30-config-file\") pod \"limitador-limitador-78c99df468-5lk8l\" (UID: \"b3637afc-5a5e-467a-a6ba-26fc55c35b30\") " pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.694759 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.694747 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7jws\" (UniqueName: \"kubernetes.io/projected/b3637afc-5a5e-467a-a6ba-26fc55c35b30-kube-api-access-v7jws\") pod \"limitador-limitador-78c99df468-5lk8l\" (UID: \"b3637afc-5a5e-467a-a6ba-26fc55c35b30\") " pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.695362 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.695337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b3637afc-5a5e-467a-a6ba-26fc55c35b30-config-file\") pod \"limitador-limitador-78c99df468-5lk8l\" (UID: \"b3637afc-5a5e-467a-a6ba-26fc55c35b30\") " pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.703769 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.703747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7jws\" (UniqueName: \"kubernetes.io/projected/b3637afc-5a5e-467a-a6ba-26fc55c35b30-kube-api-access-v7jws\") pod \"limitador-limitador-78c99df468-5lk8l\" (UID: \"b3637afc-5a5e-467a-a6ba-26fc55c35b30\") " pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.754473 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.754449 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:04.885853 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.885823 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:34:04.886753 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:34:04.886721 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3637afc_5a5e_467a_a6ba_26fc55c35b30.slice/crio-024114a73c792e387ef1158b96d5dae2945d1bf5e8ca551d5b4e9a5a8bdcb473 WatchSource:0}: Error finding container 024114a73c792e387ef1158b96d5dae2945d1bf5e8ca551d5b4e9a5a8bdcb473: Status 404 returned error can't find the container with id 024114a73c792e387ef1158b96d5dae2945d1bf5e8ca551d5b4e9a5a8bdcb473 May 31 17:34:04.888565 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:04.888546 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 17:34:05.272578 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:05.272546 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" event={"ID":"b3637afc-5a5e-467a-a6ba-26fc55c35b30","Type":"ContainerStarted","Data":"024114a73c792e387ef1158b96d5dae2945d1bf5e8ca551d5b4e9a5a8bdcb473"} May 31 17:34:08.287340 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:08.287296 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" event={"ID":"b3637afc-5a5e-467a-a6ba-26fc55c35b30","Type":"ContainerStarted","Data":"d63e03e8789357cdbe3275cc78114ab7a1e418860f03d3d38f8d9d917b9cdb57"} May 31 17:34:08.287693 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:08.287380 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:08.305131 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:08.305079 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" podStartSLOduration=1.893274868 podStartE2EDuration="4.305062629s" podCreationTimestamp="2026-05-31 17:34:04 +0000 UTC" firstStartedPulling="2026-05-31 17:34:04.888743235 +0000 UTC m=+654.485096767" lastFinishedPulling="2026-05-31 17:34:07.300531008 +0000 UTC m=+656.896884528" observedRunningTime="2026-05-31 17:34:08.304641279 +0000 UTC m=+657.900994820" watchObservedRunningTime="2026-05-31 17:34:08.305062629 +0000 UTC m=+657.901416173" May 31 17:34:19.293241 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:19.293203 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-5lk8l" May 31 17:34:36.256362 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.256328 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l"] May 31 17:34:36.264394 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.264376 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.267028 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.267003 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 31 17:34:36.267152 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.267103 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8vp4v\"" May 31 17:34:36.268027 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.268004 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 31 17:34:36.268772 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.268733 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l"] May 31 17:34:36.357222 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.357191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.357369 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.357226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.357369 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.357297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2b9\" (UniqueName: \"kubernetes.io/projected/f96a26a2-767d-424a-822a-759d1979e186-kube-api-access-2b2b9\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.458289 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.458256 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2b9\" (UniqueName: \"kubernetes.io/projected/f96a26a2-767d-424a-822a-759d1979e186-kube-api-access-2b2b9\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.458456 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.458324 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.458456 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.458354 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.458762 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.458739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.458812 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.458802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.466771 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.466741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2b9\" (UniqueName: \"kubernetes.io/projected/f96a26a2-767d-424a-822a-759d1979e186-kube-api-access-2b2b9\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.574386 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.574361 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:36.707827 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:36.707803 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l"] May 31 17:34:36.709867 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:34:36.709836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96a26a2_767d_424a_822a_759d1979e186.slice/crio-f4a0a4299f025fc95bb9b3cc72962813ff349fd4cce42dffee031fdc1f578b3e WatchSource:0}: Error finding container f4a0a4299f025fc95bb9b3cc72962813ff349fd4cce42dffee031fdc1f578b3e: Status 404 returned error can't find the container with id f4a0a4299f025fc95bb9b3cc72962813ff349fd4cce42dffee031fdc1f578b3e May 31 17:34:37.404117 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:37.404084 2567 generic.go:358] "Generic (PLEG): container finished" podID="f96a26a2-767d-424a-822a-759d1979e186" containerID="784c1e1121636a149d6531e1b06c2f6e60ef1e2054e916b28653930110970355" exitCode=0 May 31 17:34:37.404471 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:37.404175 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" event={"ID":"f96a26a2-767d-424a-822a-759d1979e186","Type":"ContainerDied","Data":"784c1e1121636a149d6531e1b06c2f6e60ef1e2054e916b28653930110970355"} May 31 17:34:37.404471 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:37.404212 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" event={"ID":"f96a26a2-767d-424a-822a-759d1979e186","Type":"ContainerStarted","Data":"f4a0a4299f025fc95bb9b3cc72962813ff349fd4cce42dffee031fdc1f578b3e"} May 31 17:34:38.409562 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:38.409527 2567 generic.go:358] "Generic (PLEG): container finished" podID="f96a26a2-767d-424a-822a-759d1979e186" containerID="2cb549ca861a82e924f7f4689b78793aef413b351f56f757ad6ba0c3f168aa2c" exitCode=0 May 31 17:34:38.409957 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:38.409618 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" event={"ID":"f96a26a2-767d-424a-822a-759d1979e186","Type":"ContainerDied","Data":"2cb549ca861a82e924f7f4689b78793aef413b351f56f757ad6ba0c3f168aa2c"} May 31 17:34:39.419179 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:39.419143 2567 generic.go:358] "Generic (PLEG): container finished" podID="f96a26a2-767d-424a-822a-759d1979e186" containerID="c1b49806f479e9341330d59e037c43f35c04ca24a6e383dfeb3cf969808ac525" exitCode=0 May 31 17:34:39.419597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:39.419223 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" event={"ID":"f96a26a2-767d-424a-822a-759d1979e186","Type":"ContainerDied","Data":"c1b49806f479e9341330d59e037c43f35c04ca24a6e383dfeb3cf969808ac525"} May 31 17:34:40.564322 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.564300 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:40.690210 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.690132 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-util\") pod \"f96a26a2-767d-424a-822a-759d1979e186\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " May 31 17:34:40.690210 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.690178 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b2b9\" (UniqueName: \"kubernetes.io/projected/f96a26a2-767d-424a-822a-759d1979e186-kube-api-access-2b2b9\") pod \"f96a26a2-767d-424a-822a-759d1979e186\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " May 31 17:34:40.690378 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.690234 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-bundle\") pod \"f96a26a2-767d-424a-822a-759d1979e186\" (UID: \"f96a26a2-767d-424a-822a-759d1979e186\") " May 31 17:34:40.690767 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.690743 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-bundle" (OuterVolumeSpecName: "bundle") pod "f96a26a2-767d-424a-822a-759d1979e186" (UID: "f96a26a2-767d-424a-822a-759d1979e186"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:34:40.692439 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.692414 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96a26a2-767d-424a-822a-759d1979e186-kube-api-access-2b2b9" (OuterVolumeSpecName: "kube-api-access-2b2b9") pod "f96a26a2-767d-424a-822a-759d1979e186" (UID: "f96a26a2-767d-424a-822a-759d1979e186"). InnerVolumeSpecName "kube-api-access-2b2b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 31 17:34:40.698722 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.698680 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-util" (OuterVolumeSpecName: "util") pod "f96a26a2-767d-424a-822a-759d1979e186" (UID: "f96a26a2-767d-424a-822a-759d1979e186"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 31 17:34:40.791290 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.791261 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b2b9\" (UniqueName: \"kubernetes.io/projected/f96a26a2-767d-424a-822a-759d1979e186-kube-api-access-2b2b9\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:34:40.791290 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.791286 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-bundle\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:34:40.791423 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:40.791297 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f96a26a2-767d-424a-822a-759d1979e186-util\") on node \"ip-10-0-143-182.ec2.internal\" DevicePath \"\"" May 31 17:34:41.435228 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:41.435202 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" May 31 17:34:41.435499 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:41.435208 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zks8l" event={"ID":"f96a26a2-767d-424a-822a-759d1979e186","Type":"ContainerDied","Data":"f4a0a4299f025fc95bb9b3cc72962813ff349fd4cce42dffee031fdc1f578b3e"} May 31 17:34:41.435499 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:34:41.435318 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4a0a4299f025fc95bb9b3cc72962813ff349fd4cce42dffee031fdc1f578b3e" May 31 17:36:06.958996 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.958959 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6cd5f5dd-q7vvt"] May 31 17:36:06.959416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959321 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="extract" May 31 17:36:06.959416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959332 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="extract" May 31 17:36:06.959416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959347 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="util" May 31 17:36:06.959416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959352 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="util" May 31 17:36:06.959416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959360 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="pull" May 31 17:36:06.959416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959365 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="pull" May 31 17:36:06.959605 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.959424 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="f96a26a2-767d-424a-822a-759d1979e186" containerName="extract" May 31 17:36:06.963941 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.963888 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:06.967682 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.967649 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 31 17:36:06.972995 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:06.972975 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cd5f5dd-q7vvt"] May 31 17:36:07.065278 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.065248 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c365233-6172-453a-870f-a821d4bc6972-maas-api-tls\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.065431 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.065327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2xf\" (UniqueName: \"kubernetes.io/projected/0c365233-6172-453a-870f-a821d4bc6972-kube-api-access-pf2xf\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.166366 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.166317 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c365233-6172-453a-870f-a821d4bc6972-maas-api-tls\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.166523 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.166447 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2xf\" (UniqueName: \"kubernetes.io/projected/0c365233-6172-453a-870f-a821d4bc6972-kube-api-access-pf2xf\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.166523 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:36:07.166453 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 31 17:36:07.166651 ip-10-0-143-182 kubenswrapper[2567]: E0531 17:36:07.166586 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c365233-6172-453a-870f-a821d4bc6972-maas-api-tls podName:0c365233-6172-453a-870f-a821d4bc6972 nodeName:}" failed. No retries permitted until 2026-05-31 17:36:07.666559313 +0000 UTC m=+777.262912843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c365233-6172-453a-870f-a821d4bc6972-maas-api-tls") pod "maas-api-6cd5f5dd-q7vvt" (UID: "0c365233-6172-453a-870f-a821d4bc6972") : secret "maas-api-serving-cert" not found May 31 17:36:07.175877 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.175848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2xf\" (UniqueName: \"kubernetes.io/projected/0c365233-6172-453a-870f-a821d4bc6972-kube-api-access-pf2xf\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.534235 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.534201 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:36:07.671458 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.671408 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c365233-6172-453a-870f-a821d4bc6972-maas-api-tls\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.674371 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.674340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c365233-6172-453a-870f-a821d4bc6972-maas-api-tls\") pod \"maas-api-6cd5f5dd-q7vvt\" (UID: \"0c365233-6172-453a-870f-a821d4bc6972\") " pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:07.876522 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:07.876493 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:08.010475 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:08.010446 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cd5f5dd-q7vvt"] May 31 17:36:08.011510 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:36:08.011483 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c365233_6172_453a_870f_a821d4bc6972.slice/crio-f36f3eed8eefe3e62a99f2b2810aa152059d69f473d78530d658ee00ae2c253c WatchSource:0}: Error finding container f36f3eed8eefe3e62a99f2b2810aa152059d69f473d78530d658ee00ae2c253c: Status 404 returned error can't find the container with id f36f3eed8eefe3e62a99f2b2810aa152059d69f473d78530d658ee00ae2c253c May 31 17:36:08.789572 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:08.789513 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" event={"ID":"0c365233-6172-453a-870f-a821d4bc6972","Type":"ContainerStarted","Data":"f36f3eed8eefe3e62a99f2b2810aa152059d69f473d78530d658ee00ae2c253c"} May 31 17:36:10.800161 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:10.800130 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" event={"ID":"0c365233-6172-453a-870f-a821d4bc6972","Type":"ContainerStarted","Data":"ba0051b2dd8a9c1ebc4eb4a2191e11881a84120076214b88b4f9dcad6849633b"} May 31 17:36:10.800545 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:10.800224 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:36:10.819607 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:10.819558 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" podStartSLOduration=2.629455137 podStartE2EDuration="4.819545954s" podCreationTimestamp="2026-05-31 17:36:06 +0000 UTC" firstStartedPulling="2026-05-31 17:36:08.012740686 +0000 UTC m=+777.609094205" lastFinishedPulling="2026-05-31 17:36:10.202831503 +0000 UTC m=+779.799185022" observedRunningTime="2026-05-31 17:36:10.817414888 +0000 UTC m=+780.413768441" watchObservedRunningTime="2026-05-31 17:36:10.819545954 +0000 UTC m=+780.415899497" May 31 17:36:16.811030 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:36:16.810999 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6cd5f5dd-q7vvt" May 31 17:37:00.721721 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:00.721682 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:37:17.105117 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.105088 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf"] May 31 17:37:17.109001 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.108976 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.113952 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.113909 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 31 17:37:17.114981 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.114957 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-srx44\"" May 31 17:37:17.115090 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.114960 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 31 17:37:17.115090 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.115080 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 31 17:37:17.124573 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.124551 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf"] May 31 17:37:17.218693 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.218664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7381bba-aa61-45ce-9fb8-3a06ef93127f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.218841 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.218721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.218841 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.218806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdlb\" (UniqueName: \"kubernetes.io/projected/e7381bba-aa61-45ce-9fb8-3a06ef93127f-kube-api-access-vqdlb\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.218945 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.218840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.218945 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.218870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.218945 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.218905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320244 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320207 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdlb\" (UniqueName: \"kubernetes.io/projected/e7381bba-aa61-45ce-9fb8-3a06ef93127f-kube-api-access-vqdlb\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320399 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320261 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320399 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320302 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320399 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320340 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320399 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320397 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7381bba-aa61-45ce-9fb8-3a06ef93127f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320614 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320444 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320974 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320974 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.320974 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.320964 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.322864 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.322841 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7381bba-aa61-45ce-9fb8-3a06ef93127f-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.323269 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.323253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7381bba-aa61-45ce-9fb8-3a06ef93127f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.327805 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.327781 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdlb\" (UniqueName: \"kubernetes.io/projected/e7381bba-aa61-45ce-9fb8-3a06ef93127f-kube-api-access-vqdlb\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf\" (UID: \"e7381bba-aa61-45ce-9fb8-3a06ef93127f\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.420306 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.420245 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:17.560817 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.560784 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf"] May 31 17:37:17.562188 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:37:17.562162 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7381bba_aa61_45ce_9fb8_3a06ef93127f.slice/crio-dcbe17274c3a6d06236af1e82685abf0744cac8b8eab48da20b970f5b48b1aba WatchSource:0}: Error finding container dcbe17274c3a6d06236af1e82685abf0744cac8b8eab48da20b970f5b48b1aba: Status 404 returned error can't find the container with id dcbe17274c3a6d06236af1e82685abf0744cac8b8eab48da20b970f5b48b1aba May 31 17:37:17.895627 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:17.895602 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:37:18.090677 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:18.090636 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" event={"ID":"e7381bba-aa61-45ce-9fb8-3a06ef93127f","Type":"ContainerStarted","Data":"dcbe17274c3a6d06236af1e82685abf0744cac8b8eab48da20b970f5b48b1aba"} May 31 17:37:21.103672 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:21.103633 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" event={"ID":"e7381bba-aa61-45ce-9fb8-3a06ef93127f","Type":"ContainerStarted","Data":"7760ece1ef34696b90f06aa4046f42ac1835e7003f2a5f89e6a744852831c515"} May 31 17:37:22.109261 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:22.109230 2567 generic.go:358] "Generic (PLEG): container finished" podID="e7381bba-aa61-45ce-9fb8-3a06ef93127f" containerID="7760ece1ef34696b90f06aa4046f42ac1835e7003f2a5f89e6a744852831c515" exitCode=0 May 31 17:37:22.109636 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:22.109322 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" event={"ID":"e7381bba-aa61-45ce-9fb8-3a06ef93127f","Type":"ContainerDied","Data":"7760ece1ef34696b90f06aa4046f42ac1835e7003f2a5f89e6a744852831c515"} May 31 17:37:24.119330 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:24.119289 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" event={"ID":"e7381bba-aa61-45ce-9fb8-3a06ef93127f","Type":"ContainerStarted","Data":"2f067f4a05d94b3964517622319900f69b211fb4782a70f8cebbe245d96cee8c"} May 31 17:37:24.138622 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:24.138571 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" podStartSLOduration=1.5938267069999998 podStartE2EDuration="7.138556863s" podCreationTimestamp="2026-05-31 17:37:17 +0000 UTC" firstStartedPulling="2026-05-31 17:37:17.563884447 +0000 UTC m=+847.160237980" lastFinishedPulling="2026-05-31 17:37:23.108614616 +0000 UTC m=+852.704968136" observedRunningTime="2026-05-31 17:37:24.137204537 +0000 UTC m=+853.733558076" watchObservedRunningTime="2026-05-31 17:37:24.138556863 +0000 UTC m=+853.734910404" May 31 17:37:27.420623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:27.420581 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:27.420623 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:27.420624 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:27.433105 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:27.433079 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:28.146939 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:28.146896 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf" May 31 17:37:29.992158 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:29.992119 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:37:47.891294 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:47.891263 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:37:52.588150 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:52.588109 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:37:55.785072 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.785042 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65"] May 31 17:37:55.804207 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.804179 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65"] May 31 17:37:55.804371 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.804301 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.807288 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.807266 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 31 17:37:55.838990 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.838963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd0084d-d82f-4f12-b160-b55b8764f05e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.839088 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.839002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.839088 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.839021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwvs\" (UniqueName: \"kubernetes.io/projected/cbd0084d-d82f-4f12-b160-b55b8764f05e-kube-api-access-pcwvs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.839160 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.839138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.839209 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.839189 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.839271 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.839256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.939586 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939559 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.939687 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939597 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.939687 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939627 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.939821 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939806 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd0084d-d82f-4f12-b160-b55b8764f05e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.939865 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939839 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.939944 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939868 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwvs\" (UniqueName: \"kubernetes.io/projected/cbd0084d-d82f-4f12-b160-b55b8764f05e-kube-api-access-pcwvs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.940014 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.939982 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.940116 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.940095 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.940182 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.940152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.941976 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.941953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd0084d-d82f-4f12-b160-b55b8764f05e-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.942422 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.942402 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd0084d-d82f-4f12-b160-b55b8764f05e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:55.949266 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:55.949244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwvs\" (UniqueName: \"kubernetes.io/projected/cbd0084d-d82f-4f12-b160-b55b8764f05e-kube-api-access-pcwvs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65\" (UID: \"cbd0084d-d82f-4f12-b160-b55b8764f05e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:56.140078 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:56.140046 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:37:56.273538 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:56.273511 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65"] May 31 17:37:56.274561 ip-10-0-143-182 kubenswrapper[2567]: W0531 17:37:56.274522 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd0084d_d82f_4f12_b160_b55b8764f05e.slice/crio-d9d1c68ea46328e5556ae1e5917a2d86527831e6757c0dca046fe970c9faa6e3 WatchSource:0}: Error finding container d9d1c68ea46328e5556ae1e5917a2d86527831e6757c0dca046fe970c9faa6e3: Status 404 returned error can't find the container with id d9d1c68ea46328e5556ae1e5917a2d86527831e6757c0dca046fe970c9faa6e3 May 31 17:37:56.984016 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:56.983978 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:37:57.258280 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:57.258188 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" event={"ID":"cbd0084d-d82f-4f12-b160-b55b8764f05e","Type":"ContainerStarted","Data":"cf0a5ea0abc46b0e06233d8f5673e47e58ecd06ae77e84134ecc73a6d5a805d9"} May 31 17:37:57.258280 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:37:57.258237 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" event={"ID":"cbd0084d-d82f-4f12-b160-b55b8764f05e","Type":"ContainerStarted","Data":"d9d1c68ea46328e5556ae1e5917a2d86527831e6757c0dca046fe970c9faa6e3"} May 31 17:38:10.922124 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:10.922046 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:38:10.924966 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:10.924910 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:38:40.430611 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:40.430578 2567 generic.go:358] "Generic (PLEG): container finished" podID="cbd0084d-d82f-4f12-b160-b55b8764f05e" containerID="cf0a5ea0abc46b0e06233d8f5673e47e58ecd06ae77e84134ecc73a6d5a805d9" exitCode=0 May 31 17:38:40.431054 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:40.430651 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" event={"ID":"cbd0084d-d82f-4f12-b160-b55b8764f05e","Type":"ContainerDied","Data":"cf0a5ea0abc46b0e06233d8f5673e47e58ecd06ae77e84134ecc73a6d5a805d9"} May 31 17:38:41.435909 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:41.435869 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" event={"ID":"cbd0084d-d82f-4f12-b160-b55b8764f05e","Type":"ContainerStarted","Data":"0fa65a0268b457c68334ec0e95791a2244d68ac55e42370709901b59fec67528"} May 31 17:38:41.456536 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:41.456491 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" podStartSLOduration=46.300984877 podStartE2EDuration="46.456477644s" podCreationTimestamp="2026-05-31 17:37:55 +0000 UTC" firstStartedPulling="2026-05-31 17:38:40.431272812 +0000 UTC m=+930.027626331" lastFinishedPulling="2026-05-31 17:38:40.586765576 +0000 UTC m=+930.183119098" observedRunningTime="2026-05-31 17:38:41.453857017 +0000 UTC m=+931.050210560" watchObservedRunningTime="2026-05-31 17:38:41.456477644 +0000 UTC m=+931.052831184" May 31 17:38:46.140557 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:46.140518 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:38:46.140979 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:46.140572 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:38:46.152958 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:46.152933 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:38:46.465946 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:38:46.465850 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65" May 31 17:39:48.684700 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:39:48.684623 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:39:59.086836 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:39:59.086803 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:40:07.788979 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:40:07.788942 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:40:17.386535 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:40:17.386499 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:40:26.095219 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:40:26.095170 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:40:36.887037 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:40:36.887000 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:41:08.583729 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:41:08.583651 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:41:14.084764 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:41:14.084728 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:41:54.285709 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:41:54.285676 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:42:10.586260 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:42:10.586223 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:42:47.793217 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:42:47.793137 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:43:04.187956 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:43:04.187902 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:43:10.958068 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:43:10.958040 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:43:10.962055 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:43:10.962035 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:43:20.296757 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:43:20.296712 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:43:35.290202 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:43:35.290171 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:44:32.696776 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:44:32.696739 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:44:41.285721 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:44:41.285685 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:44:57.992757 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:44:57.992723 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:45:07.515149 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:45:07.515107 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:45:23.686974 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:45:23.686937 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:45:30.290824 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:45:30.290741 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:46:04.694874 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:46:04.694840 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:46:12.787965 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:46:12.787931 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:46:20.789033 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:46:20.788997 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:46:30.187790 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:46:30.187751 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:46:37.980170 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:46:37.980137 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:46:55.279220 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:46:55.279183 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:47:08.597807 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:47:08.597733 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:47:54.893538 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:47:54.893505 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:00.981845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:00.981808 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:09.796845 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:09.796812 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:10.992786 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:10.992752 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:48:10.998366 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:10.998344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:48:15.890468 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:15.890431 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:26.385798 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:26.385760 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:34.693524 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:34.693436 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:42.987158 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:42.987126 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:49.894212 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:49.894174 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:48:56.014390 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:48:56.014346 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:01.602334 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:01.602298 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:08.587590 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:08.587555 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:16.785935 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:16.785888 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:22.890618 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:22.890581 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:31.484513 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:31.484477 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:36.791559 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:36.791522 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:43.988906 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:43.988872 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:49:54.490597 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:49:54.490563 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:50:03.193998 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:50:03.193902 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:50:11.896138 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:50:11.896107 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:50:23.295830 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:50:23.295793 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:52:39.187854 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:52:39.187813 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:52:47.493181 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:52:47.493148 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:53:09.538363 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:09.538327 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:53:11.030359 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:11.030332 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:53:11.038339 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:11.038319 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:53:15.798148 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:15.798111 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:53:26.691719 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:26.691688 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:53:36.697273 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:36.697236 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:53:45.584980 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:45.584944 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:53:56.389911 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:53:56.389877 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:54:04.694413 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:54:04.694375 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:54:15.883176 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:54:15.883139 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:54:24.439151 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:54:24.439114 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:54:33.819407 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:54:33.819325 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:54:42.490517 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:54:42.490475 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:54:50.095498 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:54:50.095457 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:55:16.197230 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:55:16.197191 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:55:59.189680 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:55:59.189602 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:56:08.297591 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:56:08.297557 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:56:17.289768 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:56:17.289732 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:56:24.412295 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:56:24.412260 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:56:32.803457 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:56:32.803424 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:56:45.889687 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:56:45.889651 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:56:54.698901 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:56:54.698867 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:57:02.786282 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:57:02.786238 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:57:11.120251 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:57:11.120215 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:57:19.596778 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:57:19.596743 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:57:27.583901 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:57:27.583865 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:57:39.083683 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:57:39.083646 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:57:56.587377 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:57:56.587346 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:58:05.586969 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:05.586915 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:58:11.065885 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:11.065853 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:58:11.073817 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:11.073798 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 17:58:14.481898 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:14.481861 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:58:21.191501 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:21.191468 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:58:38.990242 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:38.990206 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:58:47.991412 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:47.991381 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:58:57.183105 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:58:57.183074 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:59:03.903802 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:59:03.903710 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:59:14.583192 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:59:14.583160 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:59:21.485416 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:59:21.485385 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:59:31.885300 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:59:31.885262 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:59:44.690707 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:59:44.690666 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 17:59:53.482831 ip-10-0-143-182 kubenswrapper[2567]: I0531 17:59:53.482795 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:00:06.587995 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:00:06.587961 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:00:15.482624 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:00:15.482584 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:00:25.987210 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:00:25.987173 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:00:34.787627 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:00:34.787546 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:00:42.584283 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:00:42.584245 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:01:01.179717 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:01:01.179679 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:01:10.382568 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:01:10.382532 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:01:16.781178 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:01:16.781142 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:01:25.080720 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:01:25.080685 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:01:32.183359 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:01:32.183324 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:01:52.586867 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:01:52.583106 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:02:05.075524 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:05.075447 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5lk8l"] May 31 18:02:14.212278 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:14.212248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7db85b7c5b-v469t_2306cbd8-9816-4cd6-a342-24da5bed083b/nginx/0.log" May 31 18:02:14.314623 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:14.314594 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-87g2s_e2e70580-7f71-41a8-824c-71cc3c05e22a/manager/0.log" May 31 18:02:14.430410 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:14.430384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-dsxzn_81c18406-534a-4fd3-871d-801bdb459377/manager/0.log" May 31 18:02:14.543979 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:14.543908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cd5f5dd-q7vvt_0c365233-6172-453a-870f-a821d4bc6972/maas-api/0.log" May 31 18:02:14.985250 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:14.985221 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-p4zv7_8eb96467-2e98-4778-80e8-9efc438fa553/server/0.log" May 31 18:02:15.098900 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:15.098877 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-lvljq_0e8016da-af97-4979-a009-cac52fc21655/manager/0.log" May 31 18:02:15.341143 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:15.341119 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-wjpv9_914a7975-8500-48da-b8db-6b51d1327c79/copy-manifests/0.log" May 31 18:02:15.347280 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:15.347259 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-wjpv9_914a7975-8500-48da-b8db-6b51d1327c79/manager/0.log" May 31 18:02:16.309442 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.309414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9_6e592022-2850-40d1-a01c-385de6966f4a/extract/0.log" May 31 18:02:16.315710 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.315688 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9_6e592022-2850-40d1-a01c-385de6966f4a/util/0.log" May 31 18:02:16.322233 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.322201 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9_6e592022-2850-40d1-a01c-385de6966f4a/pull/0.log" May 31 18:02:16.429819 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.429791 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj_32ec60b9-7842-4b41-a9d1-2397792a09a0/util/0.log" May 31 18:02:16.435731 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.435713 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj_32ec60b9-7842-4b41-a9d1-2397792a09a0/pull/0.log" May 31 18:02:16.441079 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.441060 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj_32ec60b9-7842-4b41-a9d1-2397792a09a0/extract/0.log" May 31 18:02:16.542090 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.542061 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn_a751ed5a-c876-4bc7-946d-9a3dd1c05358/util/0.log" May 31 18:02:16.547760 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.547740 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn_a751ed5a-c876-4bc7-946d-9a3dd1c05358/pull/0.log" May 31 18:02:16.553808 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.553788 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn_a751ed5a-c876-4bc7-946d-9a3dd1c05358/extract/0.log" May 31 18:02:16.664737 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.664673 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh_80009251-d471-43e6-aabc-f796ad06396f/pull/0.log" May 31 18:02:16.670630 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.670613 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh_80009251-d471-43e6-aabc-f796ad06396f/extract/0.log" May 31 18:02:16.676057 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:16.676040 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh_80009251-d471-43e6-aabc-f796ad06396f/util/0.log" May 31 18:02:17.482258 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:17.482227 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5lk8l_b3637afc-5a5e-467a-a6ba-26fc55c35b30/limitador/0.log" May 31 18:02:17.599007 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:17.598979 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zpc29_07294c19-ce6d-451c-b366-ac82a0a59422/manager/0.log" May 31 18:02:18.060201 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:18.060173 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-2556t_fd42a5e2-8b7e-4328-94d4-800bd88112b0/discovery/0.log" May 31 18:02:18.169943 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:18.169900 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ccddbf6bf-5fxc8_1d9aa310-b475-4ddd-ae75-58427979f34d/kube-auth-proxy/0.log" May 31 18:02:18.612190 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:18.612163 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7849d7f7-9n294_92937b26-0004-46b5-ab90-bf4be66b2e79/router/0.log" May 31 18:02:19.066457 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:19.066429 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf_e7381bba-aa61-45ce-9fb8-3a06ef93127f/storage-initializer/0.log" May 31 18:02:19.073379 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:19.073340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-t8ctf_e7381bba-aa61-45ce-9fb8-3a06ef93127f/main/0.log" May 31 18:02:19.525528 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:19.525447 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65_cbd0084d-d82f-4f12-b160-b55b8764f05e/storage-initializer/0.log" May 31 18:02:19.533184 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:19.533154 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-snd65_cbd0084d-d82f-4f12-b160-b55b8764f05e/main/0.log" May 31 18:02:26.860872 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:26.860838 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-44f6j_884d0a31-2b81-4a27-83db-9a93130a7da3/global-pull-secret-syncer/0.log" May 31 18:02:27.006944 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:27.006891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-82gmj_b728f509-ef8b-4f1c-bb3f-29595e7c510a/konnectivity-agent/0.log" May 31 18:02:27.107996 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:27.107966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-182.ec2.internal_a816a9d5fc76ee59af61dcdc53e6d2f9/haproxy/0.log" May 31 18:02:30.790560 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.790540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9_6e592022-2850-40d1-a01c-385de6966f4a/extract/0.log" May 31 18:02:30.817406 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.817384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9_6e592022-2850-40d1-a01c-385de6966f4a/util/0.log" May 31 18:02:30.846037 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.846012 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599h6b9_6e592022-2850-40d1-a01c-385de6966f4a/pull/0.log" May 31 18:02:30.875393 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.875368 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj_32ec60b9-7842-4b41-a9d1-2397792a09a0/extract/0.log" May 31 18:02:30.899695 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.899670 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj_32ec60b9-7842-4b41-a9d1-2397792a09a0/util/0.log" May 31 18:02:30.925592 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.925563 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05mpvj_32ec60b9-7842-4b41-a9d1-2397792a09a0/pull/0.log" May 31 18:02:30.980944 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:30.980850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn_a751ed5a-c876-4bc7-946d-9a3dd1c05358/extract/0.log" May 31 18:02:31.014069 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.014044 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn_a751ed5a-c876-4bc7-946d-9a3dd1c05358/util/0.log" May 31 18:02:31.045087 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.045066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgfxn_a751ed5a-c876-4bc7-946d-9a3dd1c05358/pull/0.log" May 31 18:02:31.081255 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.081235 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh_80009251-d471-43e6-aabc-f796ad06396f/extract/0.log" May 31 18:02:31.111688 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.111668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh_80009251-d471-43e6-aabc-f796ad06396f/util/0.log" May 31 18:02:31.131774 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.131757 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lmqfh_80009251-d471-43e6-aabc-f796ad06396f/pull/0.log" May 31 18:02:31.832328 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.832299 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5lk8l_b3637afc-5a5e-467a-a6ba-26fc55c35b30/limitador/0.log" May 31 18:02:31.890741 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:31.890715 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zpc29_07294c19-ce6d-451c-b366-ac82a0a59422/manager/0.log" May 31 18:02:33.277407 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.277380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-mvgj4_bc802361-95fa-44b0-bae4-3c943c759bda/cluster-monitoring-operator/0.log" May 31 18:02:33.381241 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.381209 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5785d498d5-2zbg9_27f2f574-d0dc-4a90-aaec-747bb2028449/metrics-server/0.log" May 31 18:02:33.408585 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.408563 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-2q4ft_9ec0dfb8-e514-4c89-a3a4-a91287486e46/monitoring-plugin/0.log" May 31 18:02:33.640074 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.640049 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzrdp_7356c610-4be9-4604-92f0-7421cf141406/node-exporter/0.log" May 31 18:02:33.658601 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.658578 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzrdp_7356c610-4be9-4604-92f0-7421cf141406/kube-rbac-proxy/0.log" May 31 18:02:33.679186 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.679171 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzrdp_7356c610-4be9-4604-92f0-7421cf141406/init-textfile/0.log" May 31 18:02:33.709596 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.709573 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-d8d8f_9cf79f85-dde8-4191-b11b-4c5314c64aaf/kube-rbac-proxy-main/0.log" May 31 18:02:33.737099 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.737082 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-d8d8f_9cf79f85-dde8-4191-b11b-4c5314c64aaf/kube-rbac-proxy-self/0.log" May 31 18:02:33.761407 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:33.761389 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-d8d8f_9cf79f85-dde8-4191-b11b-4c5314c64aaf/openshift-state-metrics/0.log" May 31 18:02:34.050810 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.050783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f45d9c8c6-p8pzf_82f55b2e-0463-4c9a-9a01-cefd6a712c9b/telemeter-client/0.log" May 31 18:02:34.069632 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.069613 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f45d9c8c6-p8pzf_82f55b2e-0463-4c9a-9a01-cefd6a712c9b/reload/0.log" May 31 18:02:34.088945 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.088895 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f45d9c8c6-p8pzf_82f55b2e-0463-4c9a-9a01-cefd6a712c9b/kube-rbac-proxy/0.log" May 31 18:02:34.120271 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.120251 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/thanos-query/0.log" May 31 18:02:34.142319 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.142298 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy-web/0.log" May 31 18:02:34.162547 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.162527 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy/0.log" May 31 18:02:34.194425 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.194409 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/prom-label-proxy/0.log" May 31 18:02:34.215323 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.215305 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy-rules/0.log" May 31 18:02:34.238325 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:34.238307 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c646bdbdc-p9hl5_02ec8d0a-3024-4e78-ad29-ebedd8f1d001/kube-rbac-proxy-metrics/0.log" May 31 18:02:36.487320 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:36.487291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657694c47b-9vfcb_6d3bede4-672a-473a-b603-1e126eaa0ead/console/0.log" May 31 18:02:36.514564 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:36.514538 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-cn5gl_d17b224f-b9fd-48eb-a90b-07bd52898ec7/download-server/0.log" May 31 18:02:37.346652 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.346619 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5"] May 31 18:02:37.350483 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.350466 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.353085 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.353061 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwpvt\"/\"kube-root-ca.crt\"" May 31 18:02:37.353735 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.353713 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwpvt\"/\"default-dockercfg-lct5b\"" May 31 18:02:37.353850 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.353741 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwpvt\"/\"openshift-service-ca.crt\"" May 31 18:02:37.356082 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.356060 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5"] May 31 18:02:37.439038 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.439008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-podres\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.439165 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.439049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz72k\" (UniqueName: \"kubernetes.io/projected/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-kube-api-access-zz72k\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.439165 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.439074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-lib-modules\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.439165 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.439149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-proc\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.439289 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.439197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-sys\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540116 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540085 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-proc\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-sys\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540193 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-proc\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540217 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-podres\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540264 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz72k\" (UniqueName: \"kubernetes.io/projected/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-kube-api-access-zz72k\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-sys\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540302 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-lib-modules\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540304 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-podres\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.540490 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.540464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-lib-modules\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.549640 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.549615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz72k\" (UniqueName: \"kubernetes.io/projected/2601ce4c-50d2-45bd-b3fb-dd15e9757dc2-kube-api-access-zz72k\") pod \"perf-node-gather-daemonset-n6jq5\" (UID: \"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2\") " pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.663111 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.663043 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:37.794111 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.794077 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5"] May 31 18:02:37.805506 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.805480 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 31 18:02:37.934506 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.934485 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wh4cq_255abd80-e011-4913-83ff-1c793ecbea8f/dns/0.log" May 31 18:02:37.959693 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:37.959673 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wh4cq_255abd80-e011-4913-83ff-1c793ecbea8f/kube-rbac-proxy/0.log" May 31 18:02:38.040666 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:38.040643 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n56bh_2bbcf623-ebaf-4b6c-90ca-61040294570b/dns-node-resolver/0.log" May 31 18:02:38.287034 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:38.286957 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" event={"ID":"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2","Type":"ContainerStarted","Data":"8e04aaf9263564ca0cb65893bd6452fec7dff4ac246d208f3b7010caa6614094"} May 31 18:02:38.287034 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:38.286999 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" event={"ID":"2601ce4c-50d2-45bd-b3fb-dd15e9757dc2","Type":"ContainerStarted","Data":"6a5ea5aa65c8bbef91eff0608505df2069bda24e8df0f516eb239ad886b6a73f"} May 31 18:02:38.287194 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:38.287088 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:38.301993 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:38.301954 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" podStartSLOduration=1.301941167 podStartE2EDuration="1.301941167s" podCreationTimestamp="2026-05-31 18:02:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-31 18:02:38.299763437 +0000 UTC m=+2367.896116988" watchObservedRunningTime="2026-05-31 18:02:38.301941167 +0000 UTC m=+2367.898294705" May 31 18:02:38.586306 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:38.586276 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfqmk_6e837042-0ec8-42f1-b1d3-e0a8a598c6df/node-ca/0.log" May 31 18:02:39.465942 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:39.465892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-2556t_fd42a5e2-8b7e-4328-94d4-800bd88112b0/discovery/0.log" May 31 18:02:39.483481 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:39.483457 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ccddbf6bf-5fxc8_1d9aa310-b475-4ddd-ae75-58427979f34d/kube-auth-proxy/0.log" May 31 18:02:39.691241 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:39.691211 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d7849d7f7-9n294_92937b26-0004-46b5-ab90-bf4be66b2e79/router/0.log" May 31 18:02:40.180205 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:40.180178 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59rwv_e4e7ffee-b2de-4a65-a9e2-5d5b05b3ec1b/serve-healthcheck-canary/0.log" May 31 18:02:40.658564 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:40.658539 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8n4dm_af971b20-f790-4168-88b0-f1f44cc0347d/kube-rbac-proxy/0.log" May 31 18:02:40.676705 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:40.676683 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8n4dm_af971b20-f790-4168-88b0-f1f44cc0347d/exporter/0.log" May 31 18:02:40.695753 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:40.695730 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8n4dm_af971b20-f790-4168-88b0-f1f44cc0347d/extractor/0.log" May 31 18:02:42.785898 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:42.785869 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7db85b7c5b-v469t_2306cbd8-9816-4cd6-a342-24da5bed083b/nginx/0.log" May 31 18:02:42.807895 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:42.807869 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-87g2s_e2e70580-7f71-41a8-824c-71cc3c05e22a/manager/0.log" May 31 18:02:42.892340 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:42.892310 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-dsxzn_81c18406-534a-4fd3-871d-801bdb459377/manager/0.log" May 31 18:02:42.923529 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:42.923505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cd5f5dd-q7vvt_0c365233-6172-453a-870f-a821d4bc6972/maas-api/0.log" May 31 18:02:43.100127 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:43.100101 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-p4zv7_8eb96467-2e98-4778-80e8-9efc438fa553/server/0.log" May 31 18:02:43.143206 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:43.143181 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-lvljq_0e8016da-af97-4979-a009-cac52fc21655/manager/0.log" May 31 18:02:43.311117 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:43.311085 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-wjpv9_914a7975-8500-48da-b8db-6b51d1327c79/manager/0.log" May 31 18:02:43.328648 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:43.328624 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd7c7f585-wjpv9_914a7975-8500-48da-b8db-6b51d1327c79/copy-manifests/0.log" May 31 18:02:44.301465 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:44.301441 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwpvt/perf-node-gather-daemonset-n6jq5" May 31 18:02:44.726005 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:44.725913 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-xdm78_7d9205dc-efb5-42d9-b0e2-a415389977fe/openshift-lws-operator/0.log" May 31 18:02:49.365802 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:49.365773 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-4q9ks_6c741caf-4d9b-483a-8de2-bc412a3b763e/migrator/0.log" May 31 18:02:49.384252 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:49.384224 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-4q9ks_6c741caf-4d9b-483a-8de2-bc412a3b763e/graceful-termination/0.log" May 31 18:02:50.950289 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:50.950267 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/kube-multus-additional-cni-plugins/0.log" May 31 18:02:50.969851 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:50.969833 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/egress-router-binary-copy/0.log" May 31 18:02:50.988813 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:50.988783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/cni-plugins/0.log" May 31 18:02:51.007319 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.007303 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/bond-cni-plugin/0.log" May 31 18:02:51.026661 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.026644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/routeoverride-cni/0.log" May 31 18:02:51.046622 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.046604 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/whereabouts-cni-bincopy/0.log" May 31 18:02:51.067143 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.067116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6b6kg_d528d8dd-5562-424a-9d6c-f89b21044c54/whereabouts-cni/0.log" May 31 18:02:51.252076 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.252007 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d4zv2_ea1db81e-b014-42c3-a8b3-e680cc3bbfb9/kube-multus/0.log" May 31 18:02:51.270074 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.270050 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jxzgt_4841495e-5e34-474b-bf38-40a32da540f9/network-metrics-daemon/0.log" May 31 18:02:51.287440 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:51.287395 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jxzgt_4841495e-5e34-474b-bf38-40a32da540f9/kube-rbac-proxy/0.log" May 31 18:02:52.525545 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.525515 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-controller/0.log" May 31 18:02:52.540347 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.540309 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/0.log" May 31 18:02:52.550323 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.550297 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovn-acl-logging/1.log" May 31 18:02:52.567150 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.567124 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/kube-rbac-proxy-node/0.log" May 31 18:02:52.589189 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.589169 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/kube-rbac-proxy-ovn-metrics/0.log" May 31 18:02:52.605396 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.605328 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/northd/0.log" May 31 18:02:52.623412 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.623390 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/nbdb/0.log" May 31 18:02:52.641595 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.641576 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/sbdb/0.log" May 31 18:02:52.749549 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:52.749495 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdhhx_4f9e72db-3b0d-454c-a87c-a687dde7c6ff/ovnkube-controller/0.log" May 31 18:02:54.180682 ip-10-0-143-182 kubenswrapper[2567]: I0531 18:02:54.180650 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qhthc_f02aeb09-a0d9-4011-b5da-00f3ddf450d3/network-check-target-container/0.log"