May 21 02:05:46.121094 ip-10-0-139-23 systemd[1]: Starting Kubernetes Kubelet... May 21 02:05:46.595648 ip-10-0-139-23 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 02:05:46.595648 ip-10-0-139-23 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 02:05:46.595648 ip-10-0-139-23 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 02:05:46.595648 ip-10-0-139-23 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 02:05:46.595648 ip-10-0-139-23 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 02:05:46.597360 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.597266 2548 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 02:05:46.604664 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604645 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:46.604664 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604663 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604666 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604670 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604675 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604678 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604682 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604685 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604688 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604697 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604700 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604703 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604706 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604710 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604713 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604715 2548 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604718 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604721 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604724 2548 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604726 2548 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604729 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:46.604736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604732 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604735 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604737 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604740 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604743 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604747 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604750 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604753 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604756 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604758 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604761 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604764 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604767 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604770 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604773 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604776 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604779 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604781 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604784 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:46.605256 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604787 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604806 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604810 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604815 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604817 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604820 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604823 2548 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604826 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604828 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604831 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604834 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604839 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604842 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604845 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604849 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604852 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604855 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604858 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604861 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604863 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:46.605783 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604866 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604869 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604871 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604874 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604877 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604880 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604882 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604885 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604888 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604893 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604897 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604901 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604905 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604908 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604912 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604916 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604921 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604924 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604927 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:46.606306 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604930 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604933 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604936 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604939 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604943 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604946 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.604949 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605373 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605378 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605381 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605384 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605387 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605390 2548 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605393 2548 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605396 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605399 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605401 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605404 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605407 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605410 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:46.606765 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605412 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605415 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605419 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605422 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605424 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605427 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605429 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605432 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605435 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605438 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605441 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605444 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605446 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605449 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605452 2548 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605455 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605458 2548 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605461 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605463 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605467 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:46.607244 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605470 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605473 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605476 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605479 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605483 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605485 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605488 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605491 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605493 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605496 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605499 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605501 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605504 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605507 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605509 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605513 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605516 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605520 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605524 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:46.607784 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605527 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605530 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605533 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605535 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605538 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605540 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605543 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605546 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605548 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605551 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605554 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605557 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605560 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605563 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605566 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605568 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605571 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605574 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605577 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:46.608272 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605579 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605582 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605585 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605589 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605591 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605594 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605597 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605599 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605602 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605605 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605608 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605611 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605613 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605616 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.605619 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607213 2548 flags.go:64] FLAG: --address="0.0.0.0" May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607223 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607229 2548 flags.go:64] FLAG: --anonymous-auth="true" May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607234 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607239 2548 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607243 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 02:05:46.608838 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607247 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607252 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607256 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607259 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607263 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607267 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607270 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607273 2548 flags.go:64] FLAG: --cgroup-root="" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607277 2548 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607280 2548 flags.go:64] FLAG: --client-ca-file="" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607283 2548 flags.go:64] FLAG: --cloud-config="" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607285 2548 flags.go:64] FLAG: --cloud-provider="external" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607288 2548 flags.go:64] FLAG: --cluster-dns="[]" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607292 2548 flags.go:64] FLAG: --cluster-domain="" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607295 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607298 2548 flags.go:64] FLAG: --config-dir="" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607301 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607304 2548 flags.go:64] FLAG: --container-log-max-files="5" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607308 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607312 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607315 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607318 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607322 2548 flags.go:64] FLAG: --contention-profiling="false" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607325 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 02:05:46.609381 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607328 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607332 2548 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607335 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607339 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607342 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607345 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607348 2548 flags.go:64] FLAG: --enable-load-reader="false" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607351 2548 flags.go:64] FLAG: --enable-server="true" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607354 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607359 2548 flags.go:64] FLAG: --event-burst="100" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607362 2548 flags.go:64] FLAG: --event-qps="50" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607365 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607369 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607372 2548 flags.go:64] FLAG: --eviction-hard="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607376 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607379 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607382 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607385 2548 flags.go:64] FLAG: --eviction-soft="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607388 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607391 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607394 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607397 2548 flags.go:64] FLAG: --experimental-mounter-path="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607399 2548 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607402 2548 flags.go:64] FLAG: --fail-swap-on="true" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607405 2548 flags.go:64] FLAG: --feature-gates="" May 21 02:05:46.610019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607409 2548 flags.go:64] FLAG: --file-check-frequency="20s" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607412 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607415 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607419 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607422 2548 flags.go:64] FLAG: --healthz-port="10248" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607425 2548 flags.go:64] FLAG: --help="false" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607428 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-139-23.ec2.internal" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607431 2548 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607434 2548 flags.go:64] FLAG: --http-check-frequency="20s" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607437 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607441 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607444 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607447 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607450 2548 flags.go:64] FLAG: --image-service-endpoint="" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607453 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607456 2548 flags.go:64] FLAG: --kube-api-burst="100" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607459 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607462 2548 flags.go:64] FLAG: --kube-api-qps="50" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607465 2548 flags.go:64] FLAG: --kube-reserved="" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607468 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607472 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607475 2548 flags.go:64] FLAG: --kubelet-cgroups="" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607478 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607480 2548 flags.go:64] FLAG: --lock-file="" May 21 02:05:46.610693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607483 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607486 2548 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607490 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607495 2548 flags.go:64] FLAG: --log-json-split-stream="false" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607498 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607501 2548 flags.go:64] FLAG: --log-text-split-stream="false" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607504 2548 flags.go:64] FLAG: --logging-format="text" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607507 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607511 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607514 2548 flags.go:64] FLAG: --manifest-url="" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607517 2548 flags.go:64] FLAG: --manifest-url-header="" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607521 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607524 2548 flags.go:64] FLAG: --max-open-files="1000000" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607529 2548 flags.go:64] FLAG: --max-pods="110" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607532 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607541 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607544 2548 flags.go:64] FLAG: --memory-manager-policy="None" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607548 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607551 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607554 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607558 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607571 2548 flags.go:64] FLAG: --node-status-max-images="50" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607574 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607577 2548 flags.go:64] FLAG: --oom-score-adj="-999" May 21 02:05:46.611334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607580 2548 flags.go:64] FLAG: --pod-cidr="" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607583 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607590 2548 flags.go:64] FLAG: --pod-manifest-path="" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607594 2548 flags.go:64] FLAG: --pod-max-pids="-1" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607597 2548 flags.go:64] FLAG: --pods-per-core="0" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607601 2548 flags.go:64] FLAG: --port="10250" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607604 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607607 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0854c834eea12e939" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607610 2548 flags.go:64] FLAG: --qos-reserved="" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607613 2548 flags.go:64] FLAG: --read-only-port="10255" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607616 2548 flags.go:64] FLAG: --register-node="true" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607619 2548 flags.go:64] FLAG: --register-schedulable="true" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607622 2548 flags.go:64] FLAG: --register-with-taints="" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607626 2548 flags.go:64] FLAG: --registry-burst="10" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607629 2548 flags.go:64] FLAG: --registry-qps="5" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607632 2548 flags.go:64] FLAG: --reserved-cpus="" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607635 2548 flags.go:64] FLAG: --reserved-memory="" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607639 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607642 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607645 2548 flags.go:64] FLAG: --rotate-certificates="false" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607648 2548 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607651 2548 flags.go:64] FLAG: --runonce="false" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607654 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607658 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607661 2548 flags.go:64] FLAG: --seccomp-default="false" May 21 02:05:46.611996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607664 2548 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607667 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607671 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607674 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607677 2548 flags.go:64] FLAG: --storage-driver-password="root" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607681 2548 flags.go:64] FLAG: --storage-driver-secure="false" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607684 2548 flags.go:64] FLAG: --storage-driver-table="stats" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607687 2548 flags.go:64] FLAG: --storage-driver-user="root" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607690 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607693 2548 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607696 2548 flags.go:64] FLAG: --system-cgroups="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607699 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607704 2548 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607707 2548 flags.go:64] FLAG: --tls-cert-file="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607710 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607713 2548 flags.go:64] FLAG: --tls-min-version="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607716 2548 flags.go:64] FLAG: --tls-private-key-file="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607719 2548 flags.go:64] FLAG: --topology-manager-policy="none" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607722 2548 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607725 2548 flags.go:64] FLAG: --topology-manager-scope="container" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607729 2548 flags.go:64] FLAG: --v="2" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607733 2548 flags.go:64] FLAG: --version="false" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607737 2548 flags.go:64] FLAG: --vmodule="" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607757 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.607763 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 02:05:46.612651 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607879 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607887 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607891 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607894 2548 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607897 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607900 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607902 2548 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607906 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607909 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607913 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607917 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607921 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607925 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607928 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607930 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607933 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607935 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607938 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607940 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607943 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:46.613348 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607946 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607949 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607951 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607954 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607957 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607959 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607962 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607965 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607967 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607970 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607973 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607976 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607980 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607984 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607987 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607990 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607993 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607996 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.607999 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608002 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:46.613916 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608006 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608010 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608013 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608016 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608018 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608021 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608024 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608027 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608029 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608032 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608034 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608037 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608040 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608043 2548 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608045 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608048 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608050 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608053 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608055 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:46.614423 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608058 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608060 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608063 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608066 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608068 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608071 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608075 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608078 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608081 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608083 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608086 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608089 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608091 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608094 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608098 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608101 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608103 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608106 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608109 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608111 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:46.615117 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608114 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608116 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608119 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608121 2548 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608124 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608126 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.608129 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:46.615796 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.608942 2548 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 02:05:46.617757 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.617729 2548 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 02:05:46.617800 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.617765 2548 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 02:05:46.617830 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617820 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:46.617830 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617825 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:46.617830 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617829 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617832 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617835 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617838 2548 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617841 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617844 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617846 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617849 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617852 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617855 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617857 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617860 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617863 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617865 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617868 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617871 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617873 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617876 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617878 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617881 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:46.617910 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617884 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617887 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617890 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617892 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617895 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617898 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617900 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617903 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617906 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617909 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617912 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617915 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617918 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617920 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617923 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617926 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617928 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617931 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617934 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617936 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:46.618399 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617939 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617941 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617944 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617946 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617949 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617951 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617954 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617956 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617959 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617962 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617966 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617968 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617971 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617973 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617977 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617980 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617982 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617986 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617991 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:46.618912 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617994 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.617997 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618000 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618003 2548 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618005 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618008 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618011 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618013 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618016 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618018 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618021 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618024 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618027 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618029 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618032 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618034 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618037 2548 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618040 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618042 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618045 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:46.619379 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618048 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618051 2548 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618054 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618056 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618059 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.618064 2548 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618160 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618166 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618170 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618173 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618176 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618179 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618183 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618185 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618188 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 02:05:46.619896 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618191 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618193 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618196 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618199 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618201 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618205 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618209 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618212 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618215 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618218 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618220 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618223 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618226 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618229 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618232 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618255 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618259 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618262 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618265 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 02:05:46.620268 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618267 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618270 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618273 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618276 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618279 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618281 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618284 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618287 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618290 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618292 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618295 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618298 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618300 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618303 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618306 2548 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618309 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618313 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618316 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618318 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618321 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 02:05:46.620736 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618324 2548 feature_gate.go:328] unrecognized feature gate: Example2 May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618326 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618329 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618332 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618334 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618337 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618339 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618342 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618345 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618347 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618351 2548 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618353 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618355 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618358 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618361 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618364 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618367 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618370 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618372 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618375 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 02:05:46.621303 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618377 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618380 2548 feature_gate.go:328] unrecognized feature gate: Example May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618383 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618386 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618388 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618390 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618393 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618395 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618398 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618401 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618403 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618406 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618408 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618411 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618414 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618416 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618419 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 02:05:46.621799 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:46.618422 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 02:05:46.622218 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.618426 2548 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 02:05:46.622218 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.619405 2548 server.go:962] "Client rotation is on, will bootstrap in background" May 21 02:05:46.622475 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.622461 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 02:05:46.623477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.623465 2548 server.go:1019] "Starting client certificate rotation" May 21 02:05:46.623592 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.623574 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 02:05:46.623649 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.623622 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 02:05:46.651439 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.651410 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 02:05:46.653461 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.653437 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 02:05:46.666314 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.666294 2548 log.go:25] "Validated CRI v1 runtime API" May 21 02:05:46.673678 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.673659 2548 log.go:25] "Validated CRI v1 image API" May 21 02:05:46.675264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.675249 2548 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 02:05:46.682799 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.682779 2548 fs.go:135] Filesystem UUIDs: map[1fa41baf-0da6-4a10-bd5a-d77dbc700faf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ef12c456-c8d2-469e-9168-2a9b1f1768cf:/dev/nvme0n1p3] May 21 02:05:46.682839 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.682800 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 02:05:46.685765 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.685736 2548 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 02:05:46.687595 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.687490 2548 manager.go:217] Machine: {Timestamp:2026-05-21 02:05:46.6869236 +0000 UTC m=+0.450155976 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099942 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23e6d51b2c803e3badcc38e824d3d6 SystemUUID:ec23e6d5-1b2c-803e-3bad-cc38e824d3d6 BootID:b9f7ba3e-6c79-4011-9aae-1cf4078a9681 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:38:ba:82:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:38:ba:82:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:2c:45:24:98:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 02:05:46.689727 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.689715 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 02:05:46.689826 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.689813 2548 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 02:05:46.692760 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.692721 2548 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 02:05:46.692896 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.692763 2548 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 02:05:46.692942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.692906 2548 topology_manager.go:138] "Creating topology manager with none policy" May 21 02:05:46.692942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.692915 2548 container_manager_linux.go:306] "Creating device plugin manager" May 21 02:05:46.692942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.692922 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 02:05:46.693753 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.693735 2548 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 02:05:46.695829 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.695818 2548 state_mem.go:36] "Initialized new in-memory state store" May 21 02:05:46.695941 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.695932 2548 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 02:05:46.698567 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.698557 2548 kubelet.go:491] "Attempting to sync node with API server" May 21 02:05:46.698604 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.698573 2548 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 02:05:46.698604 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.698584 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 02:05:46.698604 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.698593 2548 kubelet.go:397] "Adding apiserver pod source" May 21 02:05:46.698604 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.698601 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 02:05:46.699825 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.699811 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 02:05:46.699868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.699838 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 02:05:46.702854 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.702822 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rkpgl" May 21 02:05:46.703023 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.703008 2548 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 02:05:46.704953 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.704938 2548 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 02:05:46.705946 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705929 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705961 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705967 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705972 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705981 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705986 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705992 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.705997 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.706004 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.706010 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 02:05:46.706052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.706018 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 02:05:46.706305 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.706238 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 02:05:46.707043 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.707032 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 02:05:46.707080 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.707045 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 02:05:46.710247 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.710232 2548 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 02:05:46.710432 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.710411 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rkpgl" May 21 02:05:46.710493 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.710434 2548 server.go:1295] "Started kubelet" May 21 02:05:46.710656 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.710495 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 02:05:46.711159 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.711117 2548 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 02:05:46.711216 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.711177 2548 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 02:05:46.711467 ip-10-0-139-23 systemd[1]: Started Kubernetes Kubelet. May 21 02:05:46.712026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.711987 2548 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 02:05:46.712164 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.712127 2548 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 02:05:46.712287 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.712268 2548 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 02:05:46.712868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.712853 2548 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 02:05:46.718579 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.718499 2548 server.go:317] "Adding debug handlers to kubelet server" May 21 02:05:46.725413 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.725392 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 02:05:46.726061 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.726038 2548 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 02:05:46.726271 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.726252 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 02:05:46.726406 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.726389 2548 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 02:05:46.726406 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.726405 2548 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 02:05:46.726521 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.726458 2548 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 02:05:46.726556 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.726526 2548 reconstruct.go:97] "Volume reconstruction finished" May 21 02:05:46.726556 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.726535 2548 reconciler.go:26] "Reconciler: start to sync state" May 21 02:05:46.727039 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727020 2548 factory.go:153] Registering CRI-O factory May 21 02:05:46.727039 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727039 2548 factory.go:223] Registration of the crio container factory successfully May 21 02:05:46.727163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727082 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 02:05:46.727163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727089 2548 factory.go:55] Registering systemd factory May 21 02:05:46.727163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727094 2548 factory.go:223] Registration of the systemd container factory successfully May 21 02:05:46.727163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727107 2548 factory.go:103] Registering Raw factory May 21 02:05:46.727163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727116 2548 manager.go:1196] Started watching for new ooms in manager May 21 02:05:46.727393 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.727357 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:46.727648 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.727635 2548 manager.go:319] Starting recovery of all containers May 21 02:05:46.729145 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.729120 2548 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:46.731046 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.731024 2548 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-23.ec2.internal\" not found" node="ip-10-0-139-23.ec2.internal" May 21 02:05:46.737686 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.737536 2548 manager.go:324] Recovery completed May 21 02:05:46.741675 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.741663 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:46.743395 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.743380 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:46.743456 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.743407 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:46.743456 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.743417 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:46.743914 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.743901 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 02:05:46.743985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.743914 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 02:05:46.743985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.743933 2548 state_mem.go:36] "Initialized new in-memory state store" May 21 02:05:46.746023 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.746008 2548 policy_none.go:49] "None policy: Start" May 21 02:05:46.746092 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.746027 2548 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 02:05:46.746092 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.746040 2548 state_mem.go:35] "Initializing new in-memory state store" May 21 02:05:46.784291 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.784277 2548 manager.go:341] "Starting Device Plugin manager" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.784306 2548 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.784316 2548 server.go:85] "Starting device plugin registration server" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.784519 2548 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.784532 2548 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.784920 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.784991 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.785000 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.785361 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 02:05:46.797694 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.785394 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:46.848559 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.848464 2548 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 02:05:46.849786 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.849770 2548 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 02:05:46.849881 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.849791 2548 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 02:05:46.849881 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.849815 2548 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 02:05:46.849881 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.849825 2548 kubelet.go:2451] "Starting kubelet main sync loop" May 21 02:05:46.849881 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.849871 2548 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 02:05:46.852068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.852041 2548 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:46.885904 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.885877 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:46.887055 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.887037 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:46.887170 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.887076 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:46.887170 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.887091 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:46.887170 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.887120 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-23.ec2.internal" May 21 02:05:46.896526 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.896502 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-23.ec2.internal" May 21 02:05:46.896636 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.896530 2548 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-23.ec2.internal\": node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:46.912643 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.912620 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:46.950960 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.950929 2548 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal"] May 21 02:05:46.951027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.951012 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:46.952437 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.952422 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:46.952515 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.952451 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:46.952515 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.952466 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:46.953847 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.953835 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:46.954017 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954005 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:46.954053 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954032 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:46.954693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954680 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:46.954775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954700 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:46.954775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954724 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:46.954775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954735 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:46.954775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954708 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:46.954896 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.954792 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:46.956447 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.956434 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" May 21 02:05:46.956488 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.956459 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 02:05:46.957101 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.957087 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" May 21 02:05:46.957182 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.957111 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" May 21 02:05:46.957182 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:46.957120 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" May 21 02:05:46.987501 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.987481 2548 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-23.ec2.internal\" not found" node="ip-10-0-139-23.ec2.internal" May 21 02:05:46.992040 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:46.992023 2548 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-23.ec2.internal\" not found" node="ip-10-0-139-23.ec2.internal" May 21 02:05:47.012800 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.012781 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.113913 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.113835 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.129215 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.129187 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7ed515d91df2f1c4f8db9d070df115a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-23.ec2.internal\" (UID: \"c7ed515d91df2f1c4f8db9d070df115a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" May 21 02:05:47.129342 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.129229 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c3269c07faa1330d9665ac8bd1d7e2ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"c3269c07faa1330d9665ac8bd1d7e2ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.129342 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.129257 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3269c07faa1330d9665ac8bd1d7e2ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"c3269c07faa1330d9665ac8bd1d7e2ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.214621 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.214577 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.229942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.229916 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7ed515d91df2f1c4f8db9d070df115a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-23.ec2.internal\" (UID: \"c7ed515d91df2f1c4f8db9d070df115a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" May 21 02:05:47.230049 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.229956 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c3269c07faa1330d9665ac8bd1d7e2ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"c3269c07faa1330d9665ac8bd1d7e2ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.230049 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.229986 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3269c07faa1330d9665ac8bd1d7e2ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"c3269c07faa1330d9665ac8bd1d7e2ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.230049 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.230022 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7ed515d91df2f1c4f8db9d070df115a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-23.ec2.internal\" (UID: \"c7ed515d91df2f1c4f8db9d070df115a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" May 21 02:05:47.230147 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.230022 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3269c07faa1330d9665ac8bd1d7e2ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"c3269c07faa1330d9665ac8bd1d7e2ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.230147 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.230025 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c3269c07faa1330d9665ac8bd1d7e2ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"c3269c07faa1330d9665ac8bd1d7e2ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.290005 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.289974 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:47.294808 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.294780 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" May 21 02:05:47.315024 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.314995 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.415538 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.415455 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.515939 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.515915 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.616391 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.616366 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.623539 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.623513 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 02:05:47.623690 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.623668 2548 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 02:05:47.623732 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.623668 2548 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 02:05:47.712558 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.712453 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 02:00:46 +0000 UTC" deadline="2028-02-09 08:46:14.54995943 +0000 UTC" May 21 02:05:47.712558 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.712490 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15102h40m26.837471703s" May 21 02:05:47.717249 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.717231 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.726461 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.726439 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 02:05:47.737979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.737957 2548 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 02:05:47.753957 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.753929 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-skwxr" May 21 02:05:47.760789 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.760772 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-skwxr" May 21 02:05:47.769137 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.769122 2548 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:47.818051 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.818022 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:47.864906 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:47.864867 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ed515d91df2f1c4f8db9d070df115a.slice/crio-5ba30795bc28e4784ccc61802fb986f04c0d0e9abcd86f309b55c309f70c06d4 WatchSource:0}: Error finding container 5ba30795bc28e4784ccc61802fb986f04c0d0e9abcd86f309b55c309f70c06d4: Status 404 returned error can't find the container with id 5ba30795bc28e4784ccc61802fb986f04c0d0e9abcd86f309b55c309f70c06d4 May 21 02:05:47.865206 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:47.865175 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3269c07faa1330d9665ac8bd1d7e2ca.slice/crio-6cba6d8db9c0de6c94dcdcadc6f810518f2cd0ed9521e636bedb27d5afa71f45 WatchSource:0}: Error finding container 6cba6d8db9c0de6c94dcdcadc6f810518f2cd0ed9521e636bedb27d5afa71f45: Status 404 returned error can't find the container with id 6cba6d8db9c0de6c94dcdcadc6f810518f2cd0ed9521e636bedb27d5afa71f45 May 21 02:05:47.868062 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:47.868045 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:05:47.918360 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:47.918323 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:48.018862 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.018835 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:48.119356 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.119328 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" May 21 02:05:48.167212 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.167188 2548 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:48.226574 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.226547 2548 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" May 21 02:05:48.239338 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.239307 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 02:05:48.240335 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.240316 2548 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" May 21 02:05:48.247646 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.247629 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 02:05:48.588396 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.588366 2548 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:48.699806 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.699775 2548 apiserver.go:52] "Watching apiserver" May 21 02:05:48.706875 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.706851 2548 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 02:05:48.708000 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.707976 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-62dvf","openshift-network-operator/iptables-alerter-7bbsf","openshift-ovn-kubernetes/ovnkube-node-6mwvl","kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal","openshift-dns/node-resolver-qhnnz","openshift-image-registry/node-ca-z7dcj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal","openshift-multus/multus-additional-cni-plugins-dkl9s","openshift-multus/network-metrics-daemon-j4nwr","openshift-network-diagnostics/network-check-target-wltsh","kube-system/konnectivity-agent-bkcns","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6","openshift-cluster-node-tuning-operator/tuned-mqlbx"] May 21 02:05:48.710154 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.710128 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.712851 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.712831 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 02:05:48.712948 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.712836 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 02:05:48.713826 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.713800 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cnw45\"" May 21 02:05:48.714679 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.714440 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 02:05:48.714851 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.714808 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.715311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.714968 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.716209 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.716188 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.716873 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.716853 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 02:05:48.717101 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.717085 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t9ppd\"" May 21 02:05:48.717395 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.717371 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 02:05:48.717471 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.717445 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 02:05:48.717508 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.717445 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 02:05:48.717557 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.717538 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 02:05:48.717921 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.717835 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5bw8b\"" May 21 02:05:48.718298 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.718281 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 02:05:48.718617 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.718503 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 02:05:48.719467 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.719177 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-62dvf" May 21 02:05:48.719812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.719617 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 02:05:48.719812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.719683 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 02:05:48.719812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.719690 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 02:05:48.719812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.719711 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sfwbl\"" May 21 02:05:48.720646 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.720460 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.721234 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721117 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 02:05:48.721234 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721140 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 02:05:48.721365 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721334 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 02:05:48.721420 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721406 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 02:05:48.721420 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721414 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t6c9k\"" May 21 02:05:48.721662 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721644 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 02:05:48.721879 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.721867 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.722534 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.722507 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5gdm\"" May 21 02:05:48.722629 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.722537 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 02:05:48.722695 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.722663 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 02:05:48.723163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.723144 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.723445 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.723258 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.724174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.723951 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 02:05:48.724174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.724022 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 02:05:48.724174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.724031 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ptpbx\"" May 21 02:05:48.724174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.724069 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 02:05:48.724737 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.724720 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:48.724883 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.724860 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:05:48.725856 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.725414 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrk4b\"" May 21 02:05:48.725856 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.725521 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6p8l9\"" May 21 02:05:48.725856 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.725814 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 02:05:48.726027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.725947 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 02:05:48.726027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.725992 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:48.726027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.726011 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 02:05:48.726114 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.726045 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:48.726270 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.726251 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 02:05:48.728173 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.728156 2548 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 02:05:48.736648 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736558 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-os-release\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.736648 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.736648 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736625 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-systemd-units\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.736648 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736646 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736784 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-cni-netd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736814 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-cni-multus\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736847 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9fj\" (UniqueName: \"kubernetes.io/projected/8dc202d3-7440-4df8-96f2-09c3248bcacb-kube-api-access-4k9fj\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736873 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-socket-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736897 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-slash\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-cnibin\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736940 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-sys-fs\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736964 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-multus-certs\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.736988 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-systemd\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-lib-modules\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737056 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-system-cni-dir\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737118 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737158 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-var-lib-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737190 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-k8s-cni-cncf-io\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737216 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvvn\" (UniqueName: \"kubernetes.io/projected/40151206-c9ef-45d8-bfd7-deacc5ac40a3-kube-api-access-ngvvn\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.738477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737247 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-run-netns\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737300 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-log-socket\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737326 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737363 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-kubelet\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737394 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2l6s\" (UniqueName: \"kubernetes.io/projected/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-kube-api-access-n2l6s\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737422 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737447 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf7jb\" (UniqueName: \"kubernetes.io/projected/07102de3-09da-457d-bfbf-08497033bb8a-kube-api-access-gf7jb\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737488 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovn-node-metrics-cert\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737515 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49001d82-4cbe-4ce3-9c34-66765327d57d-iptables-alerter-script\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737640 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-tuned\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737676 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-tmp\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737716 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80ec1771-7722-4148-8418-55065c1a240c-agent-certs\") pod \"konnectivity-agent-bkcns\" (UID: \"80ec1771-7722-4148-8418-55065c1a240c\") " pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737757 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jcs2\" (UniqueName: \"kubernetes.io/projected/27df3f90-1575-48ea-93c0-0ea337913b1b-kube-api-access-4jcs2\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737796 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysctl-conf\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737821 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-sys\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737843 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-device-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.739311 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737886 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737908 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80ec1771-7722-4148-8418-55065c1a240c-konnectivity-ca\") pod \"konnectivity-agent-bkcns\" (UID: \"80ec1771-7722-4148-8418-55065c1a240c\") " pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737946 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c226802-7713-4756-8df1-ad0e72419838-tmp-dir\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737972 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27df3f90-1575-48ea-93c0-0ea337913b1b-host\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.737995 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysctl-d\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738018 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovnkube-config\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738041 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-env-overrides\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738065 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovnkube-script-lib\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738092 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-os-release\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738130 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrqt\" (UniqueName: \"kubernetes.io/projected/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-kube-api-access-psrqt\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738160 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-systemd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738194 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-ovn\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738220 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-socket-dir-parent\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738260 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-etc-kubernetes\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738296 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738323 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40151206-c9ef-45d8-bfd7-deacc5ac40a3-cni-binary-copy\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738359 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-conf-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.739853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738387 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-var-lib-kubelet\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738408 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-host\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738441 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27df3f90-1575-48ea-93c0-0ea337913b1b-serviceca\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738487 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-modprobe-d\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738521 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-run\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738547 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cni-binary-copy\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738580 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-hostroot\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738607 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c226802-7713-4756-8df1-ad0e72419838-hosts-file\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738637 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738663 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-daemon-config\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738706 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738729 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49001d82-4cbe-4ce3-9c34-66765327d57d-host-slash\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738773 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjg5m\" (UniqueName: \"kubernetes.io/projected/9c226802-7713-4756-8df1-ad0e72419838-kube-api-access-mjg5m\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738796 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cnibin\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738826 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-etc-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738850 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-node-log\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738872 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-system-cni-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.740529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738895 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-netns\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738919 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysconfig\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738949 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738974 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-registration-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.738998 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-cni-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.739021 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-kubelet\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.739046 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r25nd\" (UniqueName: \"kubernetes.io/projected/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-kube-api-access-r25nd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.739069 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvjhs\" (UniqueName: \"kubernetes.io/projected/49001d82-4cbe-4ce3-9c34-66765327d57d-kube-api-access-qvjhs\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.739094 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-kubernetes\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.739116 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-cni-bin\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.741196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.739154 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-cni-bin\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.755492 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.755471 2548 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 02:05:48.761807 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.761779 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 02:00:47 +0000 UTC" deadline="2027-11-08 22:27:33.481548945 +0000 UTC" May 21 02:05:48.761908 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.761807 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12884h21m44.719745185s" May 21 02:05:48.840368 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840296 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-tuned\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.840368 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840337 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-tmp\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.840368 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840366 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80ec1771-7722-4148-8418-55065c1a240c-agent-certs\") pod \"konnectivity-agent-bkcns\" (UID: \"80ec1771-7722-4148-8418-55065c1a240c\") " pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840393 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jcs2\" (UniqueName: \"kubernetes.io/projected/27df3f90-1575-48ea-93c0-0ea337913b1b-kube-api-access-4jcs2\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840417 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysctl-conf\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840443 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-sys\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840467 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-device-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840510 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840535 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80ec1771-7722-4148-8418-55065c1a240c-konnectivity-ca\") pod \"konnectivity-agent-bkcns\" (UID: \"80ec1771-7722-4148-8418-55065c1a240c\") " pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840561 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c226802-7713-4756-8df1-ad0e72419838-tmp-dir\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840585 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27df3f90-1575-48ea-93c0-0ea337913b1b-host\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840609 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysctl-d\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.840630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840633 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovnkube-config\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840657 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-env-overrides\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840681 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovnkube-script-lib\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840682 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840707 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-os-release\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840734 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psrqt\" (UniqueName: \"kubernetes.io/projected/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-kube-api-access-psrqt\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840719 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840762 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-device-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840776 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-systemd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840819 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-ovn\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840861 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysctl-d\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840875 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-socket-dir-parent\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840901 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-etc-kubernetes\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840920 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27df3f90-1575-48ea-93c0-0ea337913b1b-host\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840965 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-sys\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.840983 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-systemd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841005 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-socket-dir-parent\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841034 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c226802-7713-4756-8df1-ad0e72419838-tmp-dir\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.841106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841041 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-etc-kubernetes\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841001 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-os-release\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841094 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysctl-conf\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841101 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-ovn\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841129 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841158 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40151206-c9ef-45d8-bfd7-deacc5ac40a3-cni-binary-copy\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841183 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-conf-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841207 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-var-lib-kubelet\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841229 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-host\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841254 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27df3f90-1575-48ea-93c0-0ea337913b1b-serviceca\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841276 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-modprobe-d\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841310 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-run\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841344 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-var-lib-kubelet\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841363 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cni-binary-copy\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841388 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-hostroot\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841411 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c226802-7713-4756-8df1-ad0e72419838-hosts-file\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841436 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841446 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.841916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841461 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-daemon-config\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841488 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841493 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-env-overrides\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841516 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49001d82-4cbe-4ce3-9c34-66765327d57d-host-slash\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841542 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjg5m\" (UniqueName: \"kubernetes.io/projected/9c226802-7713-4756-8df1-ad0e72419838-kube-api-access-mjg5m\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841543 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80ec1771-7722-4148-8418-55065c1a240c-konnectivity-ca\") pod \"konnectivity-agent-bkcns\" (UID: \"80ec1771-7722-4148-8418-55065c1a240c\") " pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841578 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovnkube-config\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841599 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-hostroot\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841632 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-conf-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.841678 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.841779 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:05:49.341723282 +0000 UTC m=+3.104955663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841808 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-host\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841818 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40151206-c9ef-45d8-bfd7-deacc5ac40a3-cni-binary-copy\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841861 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49001d82-4cbe-4ce3-9c34-66765327d57d-host-slash\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841897 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-run\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.841958 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-modprobe-d\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842026 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovnkube-script-lib\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.842661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842067 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cnibin\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842099 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-etc-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842122 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-node-log\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842166 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-etc-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842183 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-system-cni-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842204 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cnibin\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842201 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27df3f90-1575-48ea-93c0-0ea337913b1b-serviceca\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842227 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-netns\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842238 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-node-log\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842255 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysconfig\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842279 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-netns\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842286 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842295 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c226802-7713-4756-8df1-ad0e72419838-hosts-file\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842306 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-daemon-config\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842317 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-registration-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842326 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-system-cni-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842371 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cni-binary-copy\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842374 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-sysconfig\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.843430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842374 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-registration-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842394 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-cni-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842441 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-kubelet\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842472 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r25nd\" (UniqueName: \"kubernetes.io/projected/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-kube-api-access-r25nd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842482 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-kubelet\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842443 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-multus-cni-dir\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842497 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvjhs\" (UniqueName: \"kubernetes.io/projected/49001d82-4cbe-4ce3-9c34-66765327d57d-kube-api-access-qvjhs\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842524 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-kubernetes\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842549 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-cni-bin\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842578 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-cni-bin\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842605 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-os-release\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842631 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842657 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-systemd-units\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842660 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-cni-bin\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842685 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842711 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-cni-netd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842715 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.844224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842722 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-kubernetes\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842738 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-cni-multus\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842774 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842786 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9fj\" (UniqueName: \"kubernetes.io/projected/8dc202d3-7440-4df8-96f2-09c3248bcacb-kube-api-access-4k9fj\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842790 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-run-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842799 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-cni-netd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842817 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-cni-bin\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842844 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-cni-multus\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842858 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-os-release\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842880 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-systemd-units\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.842962 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-socket-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843003 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-slash\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843031 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-cnibin\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843055 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-sys-fs\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843088 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-multus-certs\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843090 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-socket-dir\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843121 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-systemd\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.844954 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843147 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-lib-modules\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843145 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-slash\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843176 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-system-cni-dir\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843183 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-multus-certs\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843147 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-sys-fs\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843203 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843223 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-systemd\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843229 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-var-lib-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843271 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-cnibin\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843274 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-var-lib-openvswitch\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843281 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-lib-modules\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843298 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-k8s-cni-cncf-io\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843314 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-system-cni-dir\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843323 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvvn\" (UniqueName: \"kubernetes.io/projected/40151206-c9ef-45d8-bfd7-deacc5ac40a3-kube-api-access-ngvvn\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843346 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-run-netns\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843349 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07102de3-09da-457d-bfbf-08497033bb8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843350 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-run-k8s-cni-cncf-io\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.845519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843367 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-log-socket\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843394 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-run-netns\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843410 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843437 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-log-socket\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843462 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-kubelet\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843476 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843488 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2l6s\" (UniqueName: \"kubernetes.io/projected/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-kube-api-access-n2l6s\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843513 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40151206-c9ef-45d8-bfd7-deacc5ac40a3-host-var-lib-kubelet\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843515 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843557 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gf7jb\" (UniqueName: \"kubernetes.io/projected/07102de3-09da-457d-bfbf-08497033bb8a-kube-api-access-gf7jb\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843591 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovn-node-metrics-cert\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843616 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49001d82-4cbe-4ce3-9c34-66765327d57d-iptables-alerter-script\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.843950 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.844127 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49001d82-4cbe-4ce3-9c34-66765327d57d-iptables-alerter-script\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.844689 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-tmp\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.844809 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-etc-tuned\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.846094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.845112 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80ec1771-7722-4148-8418-55065c1a240c-agent-certs\") pod \"konnectivity-agent-bkcns\" (UID: \"80ec1771-7722-4148-8418-55065c1a240c\") " pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:48.846668 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.846303 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-ovn-node-metrics-cert\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.852675 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.852438 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:48.852675 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.852463 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:48.852675 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.852476 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:48.852675 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:48.852540 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:05:49.352522696 +0000 UTC m=+3.115755061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:48.853098 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.853077 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrqt\" (UniqueName: \"kubernetes.io/projected/c8e9e6b7-2258-4399-bb6b-a294e2ebb41b-kube-api-access-psrqt\") pod \"multus-additional-cni-plugins-dkl9s\" (UID: \"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b\") " pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:48.854516 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.854492 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jcs2\" (UniqueName: \"kubernetes.io/projected/27df3f90-1575-48ea-93c0-0ea337913b1b-kube-api-access-4jcs2\") pod \"node-ca-z7dcj\" (UID: \"27df3f90-1575-48ea-93c0-0ea337913b1b\") " pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:48.855535 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.855252 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9fj\" (UniqueName: \"kubernetes.io/projected/8dc202d3-7440-4df8-96f2-09c3248bcacb-kube-api-access-4k9fj\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:48.855535 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.855441 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvjhs\" (UniqueName: \"kubernetes.io/projected/49001d82-4cbe-4ce3-9c34-66765327d57d-kube-api-access-qvjhs\") pod \"iptables-alerter-7bbsf\" (UID: \"49001d82-4cbe-4ce3-9c34-66765327d57d\") " pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:48.856764 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.856347 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" event={"ID":"c7ed515d91df2f1c4f8db9d070df115a","Type":"ContainerStarted","Data":"5ba30795bc28e4784ccc61802fb986f04c0d0e9abcd86f309b55c309f70c06d4"} May 21 02:05:48.856764 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.856935 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvvn\" (UniqueName: \"kubernetes.io/projected/40151206-c9ef-45d8-bfd7-deacc5ac40a3-kube-api-access-ngvvn\") pod \"multus-62dvf\" (UID: \"40151206-c9ef-45d8-bfd7-deacc5ac40a3\") " pod="openshift-multus/multus-62dvf" May 21 02:05:48.856764 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.857319 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjg5m\" (UniqueName: \"kubernetes.io/projected/9c226802-7713-4756-8df1-ad0e72419838-kube-api-access-mjg5m\") pod \"node-resolver-qhnnz\" (UID: \"9c226802-7713-4756-8df1-ad0e72419838\") " pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:48.857540 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.857319 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r25nd\" (UniqueName: \"kubernetes.io/projected/5dd2d2ff-9092-41fe-8ca2-aa701ac618ca-kube-api-access-r25nd\") pod \"ovnkube-node-6mwvl\" (UID: \"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:48.858115 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.858064 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" event={"ID":"c3269c07faa1330d9665ac8bd1d7e2ca","Type":"ContainerStarted","Data":"6cba6d8db9c0de6c94dcdcadc6f810518f2cd0ed9521e636bedb27d5afa71f45"} May 21 02:05:48.858335 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.858317 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2l6s\" (UniqueName: \"kubernetes.io/projected/b6575fa3-1d53-479a-82d4-ff6ae391d4f7-kube-api-access-n2l6s\") pod \"tuned-mqlbx\" (UID: \"b6575fa3-1d53-479a-82d4-ff6ae391d4f7\") " pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:48.858416 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:48.858369 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf7jb\" (UniqueName: \"kubernetes.io/projected/07102de3-09da-457d-bfbf-08497033bb8a-kube-api-access-gf7jb\") pod \"aws-ebs-csi-driver-node-jn2x6\" (UID: \"07102de3-09da-457d-bfbf-08497033bb8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:49.026886 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.026847 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bbsf" May 21 02:05:49.034645 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.034604 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bkcns" May 21 02:05:49.043317 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.043295 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" May 21 02:05:49.050093 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.050076 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:05:49.057698 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.057669 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-62dvf" May 21 02:05:49.065293 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.065272 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhnnz" May 21 02:05:49.073870 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.073842 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7dcj" May 21 02:05:49.080580 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.080558 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" May 21 02:05:49.087341 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.087323 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" May 21 02:05:49.348288 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.348253 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:49.348447 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.348429 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:49.348517 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.348505 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:05:50.348483574 +0000 UTC m=+4.111715950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:49.449417 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.449384 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:49.449562 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.449539 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:49.449597 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.449563 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:49.449597 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.449573 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:49.449689 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.449622 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:05:50.449609244 +0000 UTC m=+4.212841607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:49.481992 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.481961 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27df3f90_1575_48ea_93c0_0ea337913b1b.slice/crio-2a329dd8ebbb995a4208b31b1ae8c7d09eebcbf42b39dae8587a326b4fecbff7 WatchSource:0}: Error finding container 2a329dd8ebbb995a4208b31b1ae8c7d09eebcbf42b39dae8587a326b4fecbff7: Status 404 returned error can't find the container with id 2a329dd8ebbb995a4208b31b1ae8c7d09eebcbf42b39dae8587a326b4fecbff7 May 21 02:05:49.486523 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.486492 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07102de3_09da_457d_bfbf_08497033bb8a.slice/crio-1aab7b34d946cc56b5d2ea786e1e860a9c1579c32285d015af42a71ef8ecdccd WatchSource:0}: Error finding container 1aab7b34d946cc56b5d2ea786e1e860a9c1579c32285d015af42a71ef8ecdccd: Status 404 returned error can't find the container with id 1aab7b34d946cc56b5d2ea786e1e860a9c1579c32285d015af42a71ef8ecdccd May 21 02:05:49.487174 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.487080 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd2d2ff_9092_41fe_8ca2_aa701ac618ca.slice/crio-10124c3772a272f82f7ec7757725dce8a605fa1ed3d2c21e8e7414d174729bc6 WatchSource:0}: Error finding container 10124c3772a272f82f7ec7757725dce8a605fa1ed3d2c21e8e7414d174729bc6: Status 404 returned error can't find the container with id 10124c3772a272f82f7ec7757725dce8a605fa1ed3d2c21e8e7414d174729bc6 May 21 02:05:49.488024 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.487959 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c226802_7713_4756_8df1_ad0e72419838.slice/crio-7fd1e8f06730d2e36df8495d7ae47e1adeae58f159f792c9140f3c677b78659e WatchSource:0}: Error finding container 7fd1e8f06730d2e36df8495d7ae47e1adeae58f159f792c9140f3c677b78659e: Status 404 returned error can't find the container with id 7fd1e8f06730d2e36df8495d7ae47e1adeae58f159f792c9140f3c677b78659e May 21 02:05:49.489007 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.488969 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49001d82_4cbe_4ce3_9c34_66765327d57d.slice/crio-6fe5006c3dbb13e260f9584f344aa53f3cc340808469b8dad21c75a2eb8d5fcd WatchSource:0}: Error finding container 6fe5006c3dbb13e260f9584f344aa53f3cc340808469b8dad21c75a2eb8d5fcd: Status 404 returned error can't find the container with id 6fe5006c3dbb13e260f9584f344aa53f3cc340808469b8dad21c75a2eb8d5fcd May 21 02:05:49.489882 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.489845 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6575fa3_1d53_479a_82d4_ff6ae391d4f7.slice/crio-932a2c522c51c62652eba74321410a896312c93a6a09b1afb58a0b8e19f4800e WatchSource:0}: Error finding container 932a2c522c51c62652eba74321410a896312c93a6a09b1afb58a0b8e19f4800e: Status 404 returned error can't find the container with id 932a2c522c51c62652eba74321410a896312c93a6a09b1afb58a0b8e19f4800e May 21 02:05:49.491250 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.491218 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e9e6b7_2258_4399_bb6b_a294e2ebb41b.slice/crio-578a184a6aef92659c5a3df8797f8467a475cbdd65b9ec9cf9e5882b3a26587e WatchSource:0}: Error finding container 578a184a6aef92659c5a3df8797f8467a475cbdd65b9ec9cf9e5882b3a26587e: Status 404 returned error can't find the container with id 578a184a6aef92659c5a3df8797f8467a475cbdd65b9ec9cf9e5882b3a26587e May 21 02:05:49.492023 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.491983 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40151206_c9ef_45d8_bfd7_deacc5ac40a3.slice/crio-944837fcaafef9964a8d9053d18ff9dade73858d59d747a8b8fae205e39cb9e6 WatchSource:0}: Error finding container 944837fcaafef9964a8d9053d18ff9dade73858d59d747a8b8fae205e39cb9e6: Status 404 returned error can't find the container with id 944837fcaafef9964a8d9053d18ff9dade73858d59d747a8b8fae205e39cb9e6 May 21 02:05:49.494357 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:05:49.494318 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ec1771_7722_4148_8418_55065c1a240c.slice/crio-04c970774474df09e5774005a403f6cb29b6dbb5f104e0bbe2d2167ee0ea579e WatchSource:0}: Error finding container 04c970774474df09e5774005a403f6cb29b6dbb5f104e0bbe2d2167ee0ea579e: Status 404 returned error can't find the container with id 04c970774474df09e5774005a403f6cb29b6dbb5f104e0bbe2d2167ee0ea579e May 21 02:05:49.762475 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.762315 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 02:00:47 +0000 UTC" deadline="2027-12-11 22:29:26.524679802 +0000 UTC" May 21 02:05:49.762475 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.762471 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13676h23m36.76221155s" May 21 02:05:49.850769 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.850687 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:49.850923 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:49.850882 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:49.867862 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.867218 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" event={"ID":"c7ed515d91df2f1c4f8db9d070df115a","Type":"ContainerStarted","Data":"6d966259a59b2ad46931011cd51ff067330b6ec24d96c7315acf452b21403d70"} May 21 02:05:49.869768 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.869684 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bkcns" event={"ID":"80ec1771-7722-4148-8418-55065c1a240c","Type":"ContainerStarted","Data":"04c970774474df09e5774005a403f6cb29b6dbb5f104e0bbe2d2167ee0ea579e"} May 21 02:05:49.875250 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.875195 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-62dvf" event={"ID":"40151206-c9ef-45d8-bfd7-deacc5ac40a3","Type":"ContainerStarted","Data":"944837fcaafef9964a8d9053d18ff9dade73858d59d747a8b8fae205e39cb9e6"} May 21 02:05:49.878327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.878303 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerStarted","Data":"578a184a6aef92659c5a3df8797f8467a475cbdd65b9ec9cf9e5882b3a26587e"} May 21 02:05:49.879678 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.879655 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"10124c3772a272f82f7ec7757725dce8a605fa1ed3d2c21e8e7414d174729bc6"} May 21 02:05:49.883138 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.883056 2548 generic.go:358] "Generic (PLEG): container finished" podID="c3269c07faa1330d9665ac8bd1d7e2ca" containerID="391036f0277a873fa023e5d972c65f518294454924c02b721578f9f15d084cd8" exitCode=0 May 21 02:05:49.883233 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.883132 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" event={"ID":"c3269c07faa1330d9665ac8bd1d7e2ca","Type":"ContainerDied","Data":"391036f0277a873fa023e5d972c65f518294454924c02b721578f9f15d084cd8"} May 21 02:05:49.888347 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.888276 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" event={"ID":"b6575fa3-1d53-479a-82d4-ff6ae391d4f7","Type":"ContainerStarted","Data":"932a2c522c51c62652eba74321410a896312c93a6a09b1afb58a0b8e19f4800e"} May 21 02:05:49.890977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.890924 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bbsf" event={"ID":"49001d82-4cbe-4ce3-9c34-66765327d57d","Type":"ContainerStarted","Data":"6fe5006c3dbb13e260f9584f344aa53f3cc340808469b8dad21c75a2eb8d5fcd"} May 21 02:05:49.894345 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.894292 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhnnz" event={"ID":"9c226802-7713-4756-8df1-ad0e72419838","Type":"ContainerStarted","Data":"7fd1e8f06730d2e36df8495d7ae47e1adeae58f159f792c9140f3c677b78659e"} May 21 02:05:49.897244 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.896188 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" podStartSLOduration=1.896173071 podStartE2EDuration="1.896173071s" podCreationTimestamp="2026-05-21 02:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:05:49.881311038 +0000 UTC m=+3.644543424" watchObservedRunningTime="2026-05-21 02:05:49.896173071 +0000 UTC m=+3.659405455" May 21 02:05:49.899219 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.899166 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" event={"ID":"07102de3-09da-457d-bfbf-08497033bb8a","Type":"ContainerStarted","Data":"1aab7b34d946cc56b5d2ea786e1e860a9c1579c32285d015af42a71ef8ecdccd"} May 21 02:05:49.901034 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:49.900976 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7dcj" event={"ID":"27df3f90-1575-48ea-93c0-0ea337913b1b","Type":"ContainerStarted","Data":"2a329dd8ebbb995a4208b31b1ae8c7d09eebcbf42b39dae8587a326b4fecbff7"} May 21 02:05:50.358310 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:50.358027 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:50.368155 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.358650 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:50.368155 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.363343 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:05:52.363309076 +0000 UTC m=+6.126541498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:50.458876 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:50.458766 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:50.459041 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.458882 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:50.459041 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.458901 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:50.459041 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.458914 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:50.459041 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.458973 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:05:52.45895369 +0000 UTC m=+6.222186058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:50.853022 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:50.852484 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:50.853022 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:50.852626 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:05:50.921559 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:50.921521 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" event={"ID":"c3269c07faa1330d9665ac8bd1d7e2ca","Type":"ContainerStarted","Data":"7e0bfce938ec61f365eb5c32943d6e9d05440b367e81add595327ae79fda7ca4"} May 21 02:05:50.935282 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:50.935226 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" podStartSLOduration=2.935207106 podStartE2EDuration="2.935207106s" podCreationTimestamp="2026-05-21 02:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:05:50.934385994 +0000 UTC m=+4.697618380" watchObservedRunningTime="2026-05-21 02:05:50.935207106 +0000 UTC m=+4.698439492" May 21 02:05:51.850482 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:51.850418 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:51.850711 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:51.850550 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:52.374425 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:52.374357 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:52.374949 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.374530 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:52.374949 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.374596 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:05:56.374577135 +0000 UTC m=+10.137809504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:52.475808 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:52.475772 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:52.475993 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.475937 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:52.475993 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.475957 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:52.475993 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.475969 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:52.476138 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.476028 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:05:56.476009711 +0000 UTC m=+10.239242095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:52.850735 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:52.850239 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:52.850735 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:52.850390 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:05:53.850271 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:53.850207 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:53.850740 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:53.850337 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:54.850219 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:54.850189 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:54.850404 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:54.850340 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:05:55.850987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:55.850939 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:55.851473 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:55.851070 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:56.411090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:56.411060 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:56.411248 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.411212 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:56.411305 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.411287 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:06:04.411265874 +0000 UTC m=+18.174498250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:05:56.512550 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:56.512353 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:56.512550 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.512507 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:05:56.512550 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.512526 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:05:56.512550 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.512539 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:56.512894 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.512603 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:06:04.512584332 +0000 UTC m=+18.275816701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:05:56.851738 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:56.851430 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:56.851738 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:56.851552 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:05:57.850681 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:57.850642 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:57.850864 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:57.850773 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:58.850509 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:58.850475 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:05:58.850942 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:58.850612 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:05:59.827909 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:59.827879 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hs9cl"] May 21 02:05:59.857256 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:59.857229 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:05:59.857256 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:59.857250 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:05:59.857640 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:59.857306 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:05:59.857640 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:05:59.857432 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:05:59.939087 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:59.939063 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:05:59.939158 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:59.939104 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/558583ac-402a-4f28-a44d-9d5d39396a24-dbus\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:05:59.939158 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:05:59.939148 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/558583ac-402a-4f28-a44d-9d5d39396a24-kubelet-config\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.039812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.039732 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/558583ac-402a-4f28-a44d-9d5d39396a24-dbus\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.039957 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.039817 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/558583ac-402a-4f28-a44d-9d5d39396a24-kubelet-config\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.039957 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.039857 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.039957 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.039910 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/558583ac-402a-4f28-a44d-9d5d39396a24-dbus\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.040084 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.039964 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/558583ac-402a-4f28-a44d-9d5d39396a24-kubelet-config\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.040084 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:00.039973 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 02:06:00.040084 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:00.040054 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret podName:558583ac-402a-4f28-a44d-9d5d39396a24 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:00.54003266 +0000 UTC m=+14.303265040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret") pod "global-pull-secret-syncer-hs9cl" (UID: "558583ac-402a-4f28-a44d-9d5d39396a24") : object "kube-system"/"original-pull-secret" not registered May 21 02:06:00.542281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.542243 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:00.542449 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:00.542395 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 02:06:00.542504 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:00.542459 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret podName:558583ac-402a-4f28-a44d-9d5d39396a24 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:01.5424424 +0000 UTC m=+15.305674771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret") pod "global-pull-secret-syncer-hs9cl" (UID: "558583ac-402a-4f28-a44d-9d5d39396a24") : object "kube-system"/"original-pull-secret" not registered May 21 02:06:00.850962 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:00.850895 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:00.851107 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:00.851006 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:01.550071 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:01.550026 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:01.550511 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:01.550187 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 02:06:01.550511 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:01.550256 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret podName:558583ac-402a-4f28-a44d-9d5d39396a24 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:03.550235661 +0000 UTC m=+17.313468024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret") pod "global-pull-secret-syncer-hs9cl" (UID: "558583ac-402a-4f28-a44d-9d5d39396a24") : object "kube-system"/"original-pull-secret" not registered May 21 02:06:01.850079 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:01.849989 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:01.850231 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:01.849989 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:01.850231 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:01.850116 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:01.850231 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:01.850221 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:02.850840 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:02.850803 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:02.851268 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:02.850967 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:03.566333 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:03.566283 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:03.566572 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:03.566441 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 02:06:03.566572 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:03.566523 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret podName:558583ac-402a-4f28-a44d-9d5d39396a24 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:07.566504096 +0000 UTC m=+21.329736462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret") pod "global-pull-secret-syncer-hs9cl" (UID: "558583ac-402a-4f28-a44d-9d5d39396a24") : object "kube-system"/"original-pull-secret" not registered May 21 02:06:03.850615 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:03.850580 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:03.850828 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:03.850588 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:03.850828 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:03.850711 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:03.850828 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:03.850784 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:04.473761 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:04.473705 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:04.473932 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.473879 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:06:04.473984 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.473959 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:06:20.473942924 +0000 UTC m=+34.237175287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:06:04.574649 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:04.574607 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:04.574850 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.574783 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:06:04.574850 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.574799 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:06:04.574850 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.574809 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:06:04.574988 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.574863 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:06:20.574846721 +0000 UTC m=+34.338079309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:06:04.850366 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:04.850331 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:04.850559 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:04.850486 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:05.850399 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:05.850365 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:05.850876 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:05.850368 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:05.850876 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:05.850500 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:05.850876 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:05.850562 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:06.851170 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:06.851134 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:06.851715 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:06.851266 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:07.597163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:07.597127 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:07.597301 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:07.597281 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 02:06:07.597391 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:07.597380 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret podName:558583ac-402a-4f28-a44d-9d5d39396a24 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:15.597363071 +0000 UTC m=+29.360595447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret") pod "global-pull-secret-syncer-hs9cl" (UID: "558583ac-402a-4f28-a44d-9d5d39396a24") : object "kube-system"/"original-pull-secret" not registered May 21 02:06:07.850416 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:07.850344 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:07.850572 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:07.850345 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:07.850572 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:07.850454 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:07.850572 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:07.850520 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:08.854219 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.853853 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:08.854996 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:08.854318 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:08.959609 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.959522 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhnnz" event={"ID":"9c226802-7713-4756-8df1-ad0e72419838","Type":"ContainerStarted","Data":"dfa1a1d49436056e75f0757c2926929c5c1a2c77fa5e8e5c974af8570ce8f55e"} May 21 02:06:08.961195 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.961157 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" event={"ID":"07102de3-09da-457d-bfbf-08497033bb8a","Type":"ContainerStarted","Data":"ea1c5a91e4ec3622043645a2edeb4848cbf8d7abb881be77910e6d35afe9b7e3"} May 21 02:06:08.962575 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.962545 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7dcj" event={"ID":"27df3f90-1575-48ea-93c0-0ea337913b1b","Type":"ContainerStarted","Data":"ddc664184bb80ddae36fa203305518f9e9261f6b609134c628d227184bf940d0"} May 21 02:06:08.964030 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.964007 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bkcns" event={"ID":"80ec1771-7722-4148-8418-55065c1a240c","Type":"ContainerStarted","Data":"23bf9dedcb8e7d0a8481ebd4f089cf3c026409c6da04462a833391e0e88fb567"} May 21 02:06:08.965464 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.965443 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-62dvf" event={"ID":"40151206-c9ef-45d8-bfd7-deacc5ac40a3","Type":"ContainerStarted","Data":"5b2411958c5ac0f0bd04eb1e9905870f27152e863f4692776e9f9acc7f8e93a6"} May 21 02:06:08.967090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.967026 2548 generic.go:358] "Generic (PLEG): container finished" podID="c8e9e6b7-2258-4399-bb6b-a294e2ebb41b" containerID="09b2351cc11221f1ef39fb1a2ae28b7f3f73885bae10cf9566364040126d44f3" exitCode=0 May 21 02:06:08.967090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.967053 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerDied","Data":"09b2351cc11221f1ef39fb1a2ae28b7f3f73885bae10cf9566364040126d44f3"} May 21 02:06:08.969627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.969603 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"7e5e6075e63387215d3384931a32e16b27d342b6f3a41b15a050d20fb8eb3697"} May 21 02:06:08.969734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.969633 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"de83a92297d921f5f356e5b3d3061f3cbd10499c86d6153be63336d411435ab7"} May 21 02:06:08.969734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.969646 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"d84c48a5b68ab01cc0a4ff4ab46931243568512aa43feca70348a13959d67798"} May 21 02:06:08.969734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.969659 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"49c566a393792170b67eae80cf6c22690b423e0487c5a36ac280cb3e9c8f36bb"} May 21 02:06:08.969734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.969670 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"9692c5c7916d08c6237cbab4b0659f1e8f431822669e8d57ee47116e299029bf"} May 21 02:06:08.969734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.969681 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"282de4cdc3654a002ff63bf73c2413da400388cfa6cf759ae96b3a62bae78d62"} May 21 02:06:08.970776 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.970740 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" event={"ID":"b6575fa3-1d53-479a-82d4-ff6ae391d4f7","Type":"ContainerStarted","Data":"dd7c4eb6c3680a5dba4c7f93a4353c230847a6e4c29b273ba5dfe40d8d843d69"} May 21 02:06:08.974430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.974390 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qhnnz" podStartSLOduration=3.432320994 podStartE2EDuration="21.974379623s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.490404431 +0000 UTC m=+3.253636803" lastFinishedPulling="2026-05-21 02:06:08.032463069 +0000 UTC m=+21.795695432" observedRunningTime="2026-05-21 02:06:08.974088569 +0000 UTC m=+22.737320953" watchObservedRunningTime="2026-05-21 02:06:08.974379623 +0000 UTC m=+22.737612008" May 21 02:06:08.989066 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:08.989020 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bkcns" podStartSLOduration=4.453938204 podStartE2EDuration="22.989007868s" podCreationTimestamp="2026-05-21 02:05:46 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.497722832 +0000 UTC m=+3.260955195" lastFinishedPulling="2026-05-21 02:06:08.032792496 +0000 UTC m=+21.796024859" observedRunningTime="2026-05-21 02:06:08.988870314 +0000 UTC m=+22.752102699" watchObservedRunningTime="2026-05-21 02:06:08.989007868 +0000 UTC m=+22.752240285" May 21 02:06:09.021552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.021498 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z7dcj" podStartSLOduration=8.168489376 podStartE2EDuration="22.021484925s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.485020244 +0000 UTC m=+3.248252606" lastFinishedPulling="2026-05-21 02:06:03.338015789 +0000 UTC m=+17.101248155" observedRunningTime="2026-05-21 02:06:09.001640648 +0000 UTC m=+22.764873033" watchObservedRunningTime="2026-05-21 02:06:09.021484925 +0000 UTC m=+22.784717311" May 21 02:06:09.036837 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.036794 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-62dvf" podStartSLOduration=3.279591265 podStartE2EDuration="22.03678223s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.493959727 +0000 UTC m=+3.257192095" lastFinishedPulling="2026-05-21 02:06:08.251150685 +0000 UTC m=+22.014383060" observedRunningTime="2026-05-21 02:06:09.036461882 +0000 UTC m=+22.799694268" watchObservedRunningTime="2026-05-21 02:06:09.03678223 +0000 UTC m=+22.800014615" May 21 02:06:09.050860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.050814 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mqlbx" podStartSLOduration=3.508739237 podStartE2EDuration="22.050802433s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.492497088 +0000 UTC m=+3.255729452" lastFinishedPulling="2026-05-21 02:06:08.034560272 +0000 UTC m=+21.797792648" observedRunningTime="2026-05-21 02:06:09.050589866 +0000 UTC m=+22.813822250" watchObservedRunningTime="2026-05-21 02:06:09.050802433 +0000 UTC m=+22.814034819" May 21 02:06:09.398050 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.398023 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 02:06:09.642297 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.642218 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bkcns" May 21 02:06:09.642544 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.642334 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bkcns" May 21 02:06:09.799902 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.799763 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T02:06:09.398045671Z","UUID":"8ecd9205-8d4b-461f-8207-cbd2fa7dbf1e","Handler":null,"Name":"","Endpoint":""} May 21 02:06:09.801467 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.801446 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 02:06:09.801582 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.801485 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 02:06:09.850827 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.850798 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:09.850983 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:09.850913 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:09.850983 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.850804 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:09.851100 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:09.850997 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:09.974692 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.974659 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bbsf" event={"ID":"49001d82-4cbe-4ce3-9c34-66765327d57d","Type":"ContainerStarted","Data":"431aa80894d54a4f3f8ed49e439cabb159801753cc6dc6d16a63b518fe6ab951"} May 21 02:06:09.977284 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.977252 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" event={"ID":"07102de3-09da-457d-bfbf-08497033bb8a","Type":"ContainerStarted","Data":"0deb1caaaf5dd9cb0620774556d070ace2b6a047fb5d97ec8540291e68107ae4"} May 21 02:06:09.978042 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.977999 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bkcns" May 21 02:06:09.978900 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.978879 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bkcns" May 21 02:06:09.988229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:09.988183 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bbsf" podStartSLOduration=5.44608997 podStartE2EDuration="23.988167874s" podCreationTimestamp="2026-05-21 02:05:46 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.490974956 +0000 UTC m=+3.254207322" lastFinishedPulling="2026-05-21 02:06:08.033052854 +0000 UTC m=+21.796285226" observedRunningTime="2026-05-21 02:06:09.987885308 +0000 UTC m=+23.751117692" watchObservedRunningTime="2026-05-21 02:06:09.988167874 +0000 UTC m=+23.751400261" May 21 02:06:10.850188 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:10.850160 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:10.850375 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:10.850282 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:10.982329 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:10.982289 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"7d1b797f6aa74419c2e1db1c2a808c77bb2ef704a6b7dcd401d53bf15a4a6ad6"} May 21 02:06:10.984301 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:10.984273 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" event={"ID":"07102de3-09da-457d-bfbf-08497033bb8a","Type":"ContainerStarted","Data":"99c84ae65a816b98df381ad2ff0ea7e2ed6a4a4cca361ae19b49e29df21a2c91"} May 21 02:06:11.000612 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:11.000529 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jn2x6" podStartSLOduration=3.236297142 podStartE2EDuration="24.000514668s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.488295357 +0000 UTC m=+3.251527720" lastFinishedPulling="2026-05-21 02:06:10.252512869 +0000 UTC m=+24.015745246" observedRunningTime="2026-05-21 02:06:11.000186924 +0000 UTC m=+24.763419334" watchObservedRunningTime="2026-05-21 02:06:11.000514668 +0000 UTC m=+24.763747053" May 21 02:06:11.851073 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:11.850867 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:11.851255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:11.850867 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:11.851255 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:11.851189 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:11.851375 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:11.851264 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:12.854037 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:12.853990 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:12.854480 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:12.854159 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:13.850205 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:13.850177 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:13.850382 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:13.850178 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:13.850382 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:13.850269 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:13.850382 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:13.850338 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:13.990758 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:13.990714 2548 generic.go:358] "Generic (PLEG): container finished" podID="c8e9e6b7-2258-4399-bb6b-a294e2ebb41b" containerID="bdd2c6c2c65fd0d4868e0553e052d3de38c3ec604ad0946767186d7d5c12c2ab" exitCode=0 May 21 02:06:13.991571 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:13.990786 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerDied","Data":"bdd2c6c2c65fd0d4868e0553e052d3de38c3ec604ad0946767186d7d5c12c2ab"} May 21 02:06:13.994054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:13.993891 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" event={"ID":"5dd2d2ff-9092-41fe-8ca2-aa701ac618ca","Type":"ContainerStarted","Data":"937aac2dcd1ed142751d178bc7a9ff6bcf8efad4b793ac53d90db565d4d02965"} May 21 02:06:13.994235 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:13.994219 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:06:14.009564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:14.009542 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:06:14.032691 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:14.032652 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" podStartSLOduration=8.441632791 podStartE2EDuration="27.032640984s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.489485535 +0000 UTC m=+3.252717919" lastFinishedPulling="2026-05-21 02:06:08.080493735 +0000 UTC m=+21.843726112" observedRunningTime="2026-05-21 02:06:14.031328206 +0000 UTC m=+27.794560592" watchObservedRunningTime="2026-05-21 02:06:14.032640984 +0000 UTC m=+27.795873369" May 21 02:06:14.853540 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:14.853512 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:14.853731 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:14.853628 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:14.995712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:14.995686 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:06:14.996121 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:14.995726 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:06:15.014940 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.014894 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:06:15.307206 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.307175 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hs9cl"] May 21 02:06:15.307377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.307286 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:15.307443 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:15.307396 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:15.310711 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.310681 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wltsh"] May 21 02:06:15.310858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.310781 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:15.311763 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:15.311477 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:15.314577 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.312453 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j4nwr"] May 21 02:06:15.314577 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.312583 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:15.314577 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:15.312712 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:15.654908 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.654871 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:15.655117 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:15.655020 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 02:06:15.655117 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:15.655083 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret podName:558583ac-402a-4f28-a44d-9d5d39396a24 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:31.65506869 +0000 UTC m=+45.418301058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret") pod "global-pull-secret-syncer-hs9cl" (UID: "558583ac-402a-4f28-a44d-9d5d39396a24") : object "kube-system"/"original-pull-secret" not registered May 21 02:06:15.999024 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.998995 2548 generic.go:358] "Generic (PLEG): container finished" podID="c8e9e6b7-2258-4399-bb6b-a294e2ebb41b" containerID="6584e36109efebf68eac5451407ca1a893b3f0d50d8dc2c616a914a97da8fd76" exitCode=0 May 21 02:06:15.999462 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:15.999048 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerDied","Data":"6584e36109efebf68eac5451407ca1a893b3f0d50d8dc2c616a914a97da8fd76"} May 21 02:06:16.851295 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:16.851209 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:16.851453 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:16.851295 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:16.851453 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:16.851375 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:16.851562 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:16.851465 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:16.851562 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:16.851501 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:16.851562 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:16.851546 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:17.003142 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:17.003112 2548 generic.go:358] "Generic (PLEG): container finished" podID="c8e9e6b7-2258-4399-bb6b-a294e2ebb41b" containerID="d4a4fe792ff366071b5acc878fada4da30373e068292fb235f8166bf85f61263" exitCode=0 May 21 02:06:17.003506 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:17.003198 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerDied","Data":"d4a4fe792ff366071b5acc878fada4da30373e068292fb235f8166bf85f61263"} May 21 02:06:18.850322 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:18.850287 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:18.850783 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:18.850289 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:18.850783 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:18.850416 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:06:18.850783 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:18.850288 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:18.850783 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:18.850490 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hs9cl" podUID="558583ac-402a-4f28-a44d-9d5d39396a24" May 21 02:06:18.850783 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:18.850556 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wltsh" podUID="c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b" May 21 02:06:20.032715 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.032545 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeReady" May 21 02:06:20.033275 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.032832 2548 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 02:06:20.073312 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.073283 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kpkrw"] May 21 02:06:20.122190 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.122153 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sh86t"] May 21 02:06:20.122410 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.122333 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.124424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.124400 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 02:06:20.124561 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.124411 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 02:06:20.124615 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.124558 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2mvhm\"" May 21 02:06:20.134731 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.134689 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpkrw"] May 21 02:06:20.134731 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.134719 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sh86t"] May 21 02:06:20.134901 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.134843 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.137131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.136990 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x7bwd\"" May 21 02:06:20.137131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.137013 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 02:06:20.137131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.137025 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 02:06:20.137131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.137089 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 02:06:20.286630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.286540 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.286630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.286589 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11211a5d-656f-4fc7-bad2-06a89a7a761a-config-volume\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.286630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.286611 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7btbg\" (UniqueName: \"kubernetes.io/projected/11211a5d-656f-4fc7-bad2-06a89a7a761a-kube-api-access-7btbg\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.287055 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.286799 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11211a5d-656f-4fc7-bad2-06a89a7a761a-tmp-dir\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.287055 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.286856 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.287055 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.286894 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2qv\" (UniqueName: \"kubernetes.io/projected/ca558918-82a6-4677-9d2b-05304be9cf29-kube-api-access-kf2qv\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.387940 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.387903 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.387962 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11211a5d-656f-4fc7-bad2-06a89a7a761a-config-volume\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.387988 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7btbg\" (UniqueName: \"kubernetes.io/projected/11211a5d-656f-4fc7-bad2-06a89a7a761a-kube-api-access-7btbg\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.388041 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11211a5d-656f-4fc7-bad2-06a89a7a761a-tmp-dir\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.388078 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.388093 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.388107 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2qv\" (UniqueName: \"kubernetes.io/projected/ca558918-82a6-4677-9d2b-05304be9cf29-kube-api-access-kf2qv\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.388200 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.388170 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:06:20.888146756 +0000 UTC m=+34.651379128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:20.388545 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.388266 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:20.388545 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.388323 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:20.888306156 +0000 UTC m=+34.651538532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:20.388545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.388487 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11211a5d-656f-4fc7-bad2-06a89a7a761a-tmp-dir\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.388699 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.388671 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11211a5d-656f-4fc7-bad2-06a89a7a761a-config-volume\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.400111 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.400075 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7btbg\" (UniqueName: \"kubernetes.io/projected/11211a5d-656f-4fc7-bad2-06a89a7a761a-kube-api-access-7btbg\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.400254 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.400114 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2qv\" (UniqueName: \"kubernetes.io/projected/ca558918-82a6-4677-9d2b-05304be9cf29-kube-api-access-kf2qv\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.488923 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.488890 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:20.489187 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.489059 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:06:20.489187 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.489139 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:06:52.489120841 +0000 UTC m=+66.252353209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 02:06:20.589939 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.589856 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:20.590198 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.590134 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 02:06:20.590198 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.590159 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 02:06:20.590198 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.590177 2548 projected.go:194] Error preparing data for projected volume kube-api-access-7dw9p for pod openshift-network-diagnostics/network-check-target-wltsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:06:20.590357 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.590261 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p podName:c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b nodeName:}" failed. No retries permitted until 2026-05-21 02:06:52.590241366 +0000 UTC m=+66.353473729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dw9p" (UniqueName: "kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p") pod "network-check-target-wltsh" (UID: "c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 02:06:20.850913 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.850825 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:20.850913 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.850842 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:20.851136 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.850825 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:20.854191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.854122 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 02:06:20.854191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.854173 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 02:06:20.854191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.854183 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 02:06:20.854505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.854232 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs9f7\"" May 21 02:06:20.854505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.854179 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-97qx6\"" May 21 02:06:20.854505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.854122 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 02:06:20.891941 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.891899 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:20.891941 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:20.891940 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:20.892155 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.892055 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:20.892155 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.892055 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:20.892155 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.892114 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:21.892095121 +0000 UTC m=+35.655327489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:20.892275 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:20.892186 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:06:21.892161539 +0000 UTC m=+35.655393916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:21.899872 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:21.899833 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:21.900512 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:21.899892 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:21.900512 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:21.900004 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:21.900512 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:21.900076 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:06:23.900056788 +0000 UTC m=+37.663289154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:21.900512 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:21.900005 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:21.900512 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:21.900162 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:23.900141705 +0000 UTC m=+37.663374074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:23.917781 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:23.917733 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:23.918310 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:23.917805 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:23.918310 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:23.917860 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:23.918310 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:23.917932 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:27.917916462 +0000 UTC m=+41.681148835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:23.918310 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:23.917944 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:23.918310 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:23.917996 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:06:27.917982564 +0000 UTC m=+41.681214927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:24.019032 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:24.019002 2548 generic.go:358] "Generic (PLEG): container finished" podID="c8e9e6b7-2258-4399-bb6b-a294e2ebb41b" containerID="9a4b421be117e40142a7904ad425d2e25ff83572c00ded402b52d96e32c1be2a" exitCode=0 May 21 02:06:24.019180 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:24.019039 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerDied","Data":"9a4b421be117e40142a7904ad425d2e25ff83572c00ded402b52d96e32c1be2a"} May 21 02:06:25.023389 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:25.023355 2548 generic.go:358] "Generic (PLEG): container finished" podID="c8e9e6b7-2258-4399-bb6b-a294e2ebb41b" containerID="9e38d51099f9a6058a951d1ab229880267a942531ea0684c7c691bdbe16de399" exitCode=0 May 21 02:06:25.023879 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:25.023421 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerDied","Data":"9e38d51099f9a6058a951d1ab229880267a942531ea0684c7c691bdbe16de399"} May 21 02:06:26.028087 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:26.027896 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" event={"ID":"c8e9e6b7-2258-4399-bb6b-a294e2ebb41b","Type":"ContainerStarted","Data":"901e5cd7daf6d0d09da79d0d8ee43828e24a29e372550743ecfcd485d1a9c46f"} May 21 02:06:26.048321 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:26.048261 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dkl9s" podStartSLOduration=5.019189971 podStartE2EDuration="39.048247864s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:05:49.49348166 +0000 UTC m=+3.256714022" lastFinishedPulling="2026-05-21 02:06:23.522539549 +0000 UTC m=+37.285771915" observedRunningTime="2026-05-21 02:06:26.04797106 +0000 UTC m=+39.811203493" watchObservedRunningTime="2026-05-21 02:06:26.048247864 +0000 UTC m=+39.811480285" May 21 02:06:27.943725 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:27.943678 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:27.943725 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:27.943728 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:27.944152 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:27.943848 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:27.944152 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:27.943872 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:27.944152 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:27.943913 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:35.943897352 +0000 UTC m=+49.707129715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:27.944152 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:27.943930 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:06:35.943924423 +0000 UTC m=+49.707156785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:31.672223 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:31.672183 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:31.675174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:31.675146 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/558583ac-402a-4f28-a44d-9d5d39396a24-original-pull-secret\") pod \"global-pull-secret-syncer-hs9cl\" (UID: \"558583ac-402a-4f28-a44d-9d5d39396a24\") " pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:31.970577 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:31.970496 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hs9cl" May 21 02:06:32.138393 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:32.138364 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hs9cl"] May 21 02:06:32.141777 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:06:32.141728 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558583ac_402a_4f28_a44d_9d5d39396a24.slice/crio-9aca4998174ec7563a9f8ddfd1d398fc4145c18c8d3373ac49c2298a16a2fae6 WatchSource:0}: Error finding container 9aca4998174ec7563a9f8ddfd1d398fc4145c18c8d3373ac49c2298a16a2fae6: Status 404 returned error can't find the container with id 9aca4998174ec7563a9f8ddfd1d398fc4145c18c8d3373ac49c2298a16a2fae6 May 21 02:06:33.044016 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:33.043979 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hs9cl" event={"ID":"558583ac-402a-4f28-a44d-9d5d39396a24","Type":"ContainerStarted","Data":"9aca4998174ec7563a9f8ddfd1d398fc4145c18c8d3373ac49c2298a16a2fae6"} May 21 02:06:36.003915 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:36.003870 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:36.004353 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:36.003940 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:36.004353 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:36.004127 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:36.004353 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:36.004205 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:06:52.004184552 +0000 UTC m=+65.767416938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:36.004608 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:36.004578 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:36.004736 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:36.004651 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:06:52.004634337 +0000 UTC m=+65.767866705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:37.052775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:37.052718 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hs9cl" event={"ID":"558583ac-402a-4f28-a44d-9d5d39396a24","Type":"ContainerStarted","Data":"bc2b79329cc3d86961b7c0f40a46d55bfa0e55750aebaad82455e2aba15326ce"} May 21 02:06:37.066388 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:37.066301 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hs9cl" podStartSLOduration=33.768576805 podStartE2EDuration="38.066283185s" podCreationTimestamp="2026-05-21 02:05:59 +0000 UTC" firstStartedPulling="2026-05-21 02:06:32.14355059 +0000 UTC m=+45.906782956" lastFinishedPulling="2026-05-21 02:06:36.441256971 +0000 UTC m=+50.204489336" observedRunningTime="2026-05-21 02:06:37.065917284 +0000 UTC m=+50.829149668" watchObservedRunningTime="2026-05-21 02:06:37.066283185 +0000 UTC m=+50.829515570" May 21 02:06:47.013197 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:47.013167 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mwvl" May 21 02:06:52.026306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.026268 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:06:52.026306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.026312 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:06:52.026715 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:52.026419 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:06:52.026715 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:52.026489 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:07:24.026474832 +0000 UTC m=+97.789707195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:06:52.026715 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:52.026419 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:06:52.026715 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:52.026565 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:07:24.026552605 +0000 UTC m=+97.789784973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:06:52.529440 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.529410 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:06:52.531857 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.531838 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 02:06:52.539784 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:52.539764 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 02:06:52.539854 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:06:52.539846 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:07:56.539830144 +0000 UTC m=+130.303062511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : secret "metrics-daemon-secret" not found May 21 02:06:52.630641 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.630593 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:52.632890 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.632874 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 02:06:52.643121 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.643101 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 02:06:52.654309 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.654274 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dw9p\" (UniqueName: \"kubernetes.io/projected/c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b-kube-api-access-7dw9p\") pod \"network-check-target-wltsh\" (UID: \"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b\") " pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:52.665105 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.665084 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-97qx6\"" May 21 02:06:52.673813 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.673795 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:52.789695 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:52.789619 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wltsh"] May 21 02:06:52.792814 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:06:52.792789 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e3a89e_cc1c_40b8_85a3_144b8c6e6f3b.slice/crio-8925f42f4187e38f4f16986e3afa0354ceb9c53d4b86c18d2d90f1893d67cc80 WatchSource:0}: Error finding container 8925f42f4187e38f4f16986e3afa0354ceb9c53d4b86c18d2d90f1893d67cc80: Status 404 returned error can't find the container with id 8925f42f4187e38f4f16986e3afa0354ceb9c53d4b86c18d2d90f1893d67cc80 May 21 02:06:53.084472 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:53.084377 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wltsh" event={"ID":"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b","Type":"ContainerStarted","Data":"8925f42f4187e38f4f16986e3afa0354ceb9c53d4b86c18d2d90f1893d67cc80"} May 21 02:06:56.092139 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:56.092100 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wltsh" event={"ID":"c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b","Type":"ContainerStarted","Data":"94d1dd553fbb8dc027cec25eb4fb9f579aee50b30797bc6a84bb57100eb53bc7"} May 21 02:06:56.092611 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:56.092238 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:06:56.106737 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:06:56.106689 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wltsh" podStartSLOduration=66.519691125 podStartE2EDuration="1m9.106676897s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:06:52.795117495 +0000 UTC m=+66.558349858" lastFinishedPulling="2026-05-21 02:06:55.382103268 +0000 UTC m=+69.145335630" observedRunningTime="2026-05-21 02:06:56.10573025 +0000 UTC m=+69.868962648" watchObservedRunningTime="2026-05-21 02:06:56.106676897 +0000 UTC m=+69.869909282" May 21 02:07:24.048983 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:24.048832 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:07:24.048983 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:24.048885 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:07:24.049500 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:24.048986 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 02:07:24.049500 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:24.049058 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls podName:11211a5d-656f-4fc7-bad2-06a89a7a761a nodeName:}" failed. No retries permitted until 2026-05-21 02:08:28.049037904 +0000 UTC m=+161.812270292 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls") pod "dns-default-kpkrw" (UID: "11211a5d-656f-4fc7-bad2-06a89a7a761a") : secret "dns-default-metrics-tls" not found May 21 02:07:24.049500 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:24.048986 2548 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 02:07:24.049500 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:24.049092 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert podName:ca558918-82a6-4677-9d2b-05304be9cf29 nodeName:}" failed. No retries permitted until 2026-05-21 02:08:28.049081751 +0000 UTC m=+161.812314129 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert") pod "ingress-canary-sh86t" (UID: "ca558918-82a6-4677-9d2b-05304be9cf29") : secret "canary-serving-cert" not found May 21 02:07:27.097068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:27.097036 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wltsh" May 21 02:07:39.876445 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.876417 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s"] May 21 02:07:39.878005 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.877988 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" May 21 02:07:39.880195 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.880174 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 02:07:39.880505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.880490 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 02:07:39.881304 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.881285 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mnfdn\"" May 21 02:07:39.886948 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.886928 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s"] May 21 02:07:39.955623 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.955588 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6g4w\" (UniqueName: \"kubernetes.io/projected/74fcbd3b-3537-4505-923b-8d29d6d964ba-kube-api-access-d6g4w\") pod \"volume-data-source-validator-5cf8c89d64-l7b8s\" (UID: \"74fcbd3b-3537-4505-923b-8d29d6d964ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" May 21 02:07:39.988182 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.988147 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-4f554"] May 21 02:07:39.989955 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.989939 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-599d99695-789jg"] May 21 02:07:39.990107 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.990093 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:39.992965 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.992918 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 02:07:39.993091 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.992990 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g8z5n\"" May 21 02:07:39.994012 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.993225 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 02:07:39.994012 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.993341 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 02:07:39.994012 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.993428 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 02:07:39.995112 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.995093 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:39.998186 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.998162 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 02:07:39.998186 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.998176 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 02:07:39.999052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.999033 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 02:07:39.999197 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:39.999135 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hg56n\"" May 21 02:07:40.002253 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.002234 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-4f554"] May 21 02:07:40.002339 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.002325 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 02:07:40.004905 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.004883 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 02:07:40.013677 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.013651 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599d99695-789jg"] May 21 02:07:40.056591 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056559 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6g4w\" (UniqueName: \"kubernetes.io/projected/74fcbd3b-3537-4505-923b-8d29d6d964ba-kube-api-access-d6g4w\") pod \"volume-data-source-validator-5cf8c89d64-l7b8s\" (UID: \"74fcbd3b-3537-4505-923b-8d29d6d964ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" May 21 02:07:40.056591 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056594 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-image-registry-private-configuration\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056627 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/04506638-714a-4d83-8197-57a6d6e7f667-snapshots\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056642 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04506638-714a-4d83-8197-57a6d6e7f667-serving-cert\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056667 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-ca-trust-extracted\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056696 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5w6\" (UniqueName: \"kubernetes.io/projected/04506638-714a-4d83-8197-57a6d6e7f667-kube-api-access-mk5w6\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056726 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-bound-sa-token\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056767 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04506638-714a-4d83-8197-57a6d6e7f667-service-ca-bundle\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.056858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.057120 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056862 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04506638-714a-4d83-8197-57a6d6e7f667-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.057120 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056898 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-trusted-ca\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.057120 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056952 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04506638-714a-4d83-8197-57a6d6e7f667-tmp\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.057120 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056969 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-installation-pull-secrets\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.057120 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.056987 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-certificates\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.057120 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.057011 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7869n\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-kube-api-access-7869n\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.063817 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.063791 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6g4w\" (UniqueName: \"kubernetes.io/projected/74fcbd3b-3537-4505-923b-8d29d6d964ba-kube-api-access-d6g4w\") pod \"volume-data-source-validator-5cf8c89d64-l7b8s\" (UID: \"74fcbd3b-3537-4505-923b-8d29d6d964ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" May 21 02:07:40.158224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158118 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04506638-714a-4d83-8197-57a6d6e7f667-service-ca-bundle\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.158224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158177 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.158224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158224 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04506638-714a-4d83-8197-57a6d6e7f667-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158250 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-trusted-ca\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158286 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04506638-714a-4d83-8197-57a6d6e7f667-tmp\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158308 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-installation-pull-secrets\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158336 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-certificates\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:40.158356 2548 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:40.158385 2548 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d99695-789jg: secret "image-registry-tls" not found May 21 02:07:40.158492 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:40.158463 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls podName:4d3bccdd-f1b0-457d-b82e-8e49d899a83b nodeName:}" failed. No retries permitted until 2026-05-21 02:07:40.65844175 +0000 UTC m=+114.421674120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls") pod "image-registry-599d99695-789jg" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b") : secret "image-registry-tls" not found May 21 02:07:40.158868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158364 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7869n\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-kube-api-access-7869n\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.158868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158671 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04506638-714a-4d83-8197-57a6d6e7f667-tmp\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.158868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158670 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-image-registry-private-configuration\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.158868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158774 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/04506638-714a-4d83-8197-57a6d6e7f667-snapshots\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.158868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158810 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04506638-714a-4d83-8197-57a6d6e7f667-serving-cert\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.158868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158841 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-ca-trust-extracted\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.159155 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158900 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5w6\" (UniqueName: \"kubernetes.io/projected/04506638-714a-4d83-8197-57a6d6e7f667-kube-api-access-mk5w6\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.159155 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158970 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-bound-sa-token\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.159362 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.158843 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04506638-714a-4d83-8197-57a6d6e7f667-service-ca-bundle\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.159543 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.159520 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/04506638-714a-4d83-8197-57a6d6e7f667-snapshots\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.159762 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.159721 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-ca-trust-extracted\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.159938 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.159911 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-certificates\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.160519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.160496 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-trusted-ca\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.160832 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.160806 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04506638-714a-4d83-8197-57a6d6e7f667-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.161170 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.161153 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04506638-714a-4d83-8197-57a6d6e7f667-serving-cert\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.161339 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.161321 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-image-registry-private-configuration\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.161448 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.161427 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-installation-pull-secrets\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.168196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.168176 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7869n\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-kube-api-access-7869n\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.168291 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.168254 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-bound-sa-token\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.169010 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.168977 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5w6\" (UniqueName: \"kubernetes.io/projected/04506638-714a-4d83-8197-57a6d6e7f667-kube-api-access-mk5w6\") pod \"insights-operator-78bdfb888c-4f554\" (UID: \"04506638-714a-4d83-8197-57a6d6e7f667\") " pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.186810 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.186785 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" May 21 02:07:40.302438 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.302406 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s"] May 21 02:07:40.302583 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.302452 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-4f554" May 21 02:07:40.307052 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:07:40.307026 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fcbd3b_3537_4505_923b_8d29d6d964ba.slice/crio-7c4905f9cdbee7fbb530ef29a9a9b8b5bbb171da838ec4aa7a8bf2ec872c0454 WatchSource:0}: Error finding container 7c4905f9cdbee7fbb530ef29a9a9b8b5bbb171da838ec4aa7a8bf2ec872c0454: Status 404 returned error can't find the container with id 7c4905f9cdbee7fbb530ef29a9a9b8b5bbb171da838ec4aa7a8bf2ec872c0454 May 21 02:07:40.416959 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.416879 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-4f554"] May 21 02:07:40.420322 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:07:40.420287 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04506638_714a_4d83_8197_57a6d6e7f667.slice/crio-ca8d6cb80dc95e695d976f39f70aa8dea7c70c31702b5130992f5bd082b01619 WatchSource:0}: Error finding container ca8d6cb80dc95e695d976f39f70aa8dea7c70c31702b5130992f5bd082b01619: Status 404 returned error can't find the container with id ca8d6cb80dc95e695d976f39f70aa8dea7c70c31702b5130992f5bd082b01619 May 21 02:07:40.662419 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:40.662382 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:40.662577 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:40.662506 2548 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:40.662577 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:40.662520 2548 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d99695-789jg: secret "image-registry-tls" not found May 21 02:07:40.662577 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:40.662571 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls podName:4d3bccdd-f1b0-457d-b82e-8e49d899a83b nodeName:}" failed. No retries permitted until 2026-05-21 02:07:41.662554914 +0000 UTC m=+115.425787279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls") pod "image-registry-599d99695-789jg" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b") : secret "image-registry-tls" not found May 21 02:07:41.181812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:41.181772 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" event={"ID":"74fcbd3b-3537-4505-923b-8d29d6d964ba","Type":"ContainerStarted","Data":"7c4905f9cdbee7fbb530ef29a9a9b8b5bbb171da838ec4aa7a8bf2ec872c0454"} May 21 02:07:41.183343 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:41.183311 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4f554" event={"ID":"04506638-714a-4d83-8197-57a6d6e7f667","Type":"ContainerStarted","Data":"ca8d6cb80dc95e695d976f39f70aa8dea7c70c31702b5130992f5bd082b01619"} May 21 02:07:41.669673 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:41.669650 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:41.669901 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:41.669878 2548 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:41.669991 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:41.669904 2548 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d99695-789jg: secret "image-registry-tls" not found May 21 02:07:41.669991 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:41.669957 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls podName:4d3bccdd-f1b0-457d-b82e-8e49d899a83b nodeName:}" failed. No retries permitted until 2026-05-21 02:07:43.669941764 +0000 UTC m=+117.433174133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls") pod "image-registry-599d99695-789jg" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b") : secret "image-registry-tls" not found May 21 02:07:42.186762 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:42.186706 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" event={"ID":"74fcbd3b-3537-4505-923b-8d29d6d964ba","Type":"ContainerStarted","Data":"781be71152bace86e503bbff9321a3e3ad5bb97958878b0340fede5d1125162e"} May 21 02:07:42.201845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:42.201791 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-l7b8s" podStartSLOduration=1.8508260029999999 podStartE2EDuration="3.201776515s" podCreationTimestamp="2026-05-21 02:07:39 +0000 UTC" firstStartedPulling="2026-05-21 02:07:40.308806639 +0000 UTC m=+114.072039002" lastFinishedPulling="2026-05-21 02:07:41.659757137 +0000 UTC m=+115.422989514" observedRunningTime="2026-05-21 02:07:42.200390263 +0000 UTC m=+115.963622649" watchObservedRunningTime="2026-05-21 02:07:42.201776515 +0000 UTC m=+115.965008899" May 21 02:07:43.190101 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.190066 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4f554" event={"ID":"04506638-714a-4d83-8197-57a6d6e7f667","Type":"ContainerStarted","Data":"3f6b8cc086126242fb9ad039179d193de746ac2d6da6f2c58ea3cbac63773814"} May 21 02:07:43.209354 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.209308 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-4f554" podStartSLOduration=2.316846277 podStartE2EDuration="4.209294175s" podCreationTimestamp="2026-05-21 02:07:39 +0000 UTC" firstStartedPulling="2026-05-21 02:07:40.422140281 +0000 UTC m=+114.185372648" lastFinishedPulling="2026-05-21 02:07:42.314588178 +0000 UTC m=+116.077820546" observedRunningTime="2026-05-21 02:07:43.209113664 +0000 UTC m=+116.972346061" watchObservedRunningTime="2026-05-21 02:07:43.209294175 +0000 UTC m=+116.972526561" May 21 02:07:43.686871 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.686831 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:43.687045 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:43.687008 2548 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:43.687045 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:43.687031 2548 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d99695-789jg: secret "image-registry-tls" not found May 21 02:07:43.687115 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:43.687101 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls podName:4d3bccdd-f1b0-457d-b82e-8e49d899a83b nodeName:}" failed. No retries permitted until 2026-05-21 02:07:47.687080854 +0000 UTC m=+121.450313231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls") pod "image-registry-599d99695-789jg" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b") : secret "image-registry-tls" not found May 21 02:07:43.834182 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.834146 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r"] May 21 02:07:43.835951 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.835935 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:43.838102 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.838081 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 02:07:43.838202 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.838142 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 02:07:43.839159 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.839134 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 02:07:43.839159 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.839152 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v9pbt\"" May 21 02:07:43.839327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.839222 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 02:07:43.842983 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.842961 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r"] May 21 02:07:43.988901 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.988872 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9tp\" (UniqueName: \"kubernetes.io/projected/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-kube-api-access-bd9tp\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:43.989088 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.988922 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-serving-cert\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:43.989088 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:43.989019 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-config\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.089907 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.089869 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-serving-cert\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.090075 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.089929 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-config\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.090075 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.089980 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9tp\" (UniqueName: \"kubernetes.io/projected/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-kube-api-access-bd9tp\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.090551 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.090532 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-config\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.091994 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.091977 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-serving-cert\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.097668 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.097645 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9tp\" (UniqueName: \"kubernetes.io/projected/05fc18aa-dbbd-4da2-88ab-4ff7aada0845-kube-api-access-bd9tp\") pod \"service-ca-operator-57b5b68b8-mzh7r\" (UID: \"05fc18aa-dbbd-4da2-88ab-4ff7aada0845\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.145334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.145305 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" May 21 02:07:44.263085 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:44.263018 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r"] May 21 02:07:44.265845 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:07:44.265812 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fc18aa_dbbd_4da2_88ab_4ff7aada0845.slice/crio-4bdbbd11d47cfeffc02a0fa621bd6641a8d39e75bb88cdc5ccf777194c774b4e WatchSource:0}: Error finding container 4bdbbd11d47cfeffc02a0fa621bd6641a8d39e75bb88cdc5ccf777194c774b4e: Status 404 returned error can't find the container with id 4bdbbd11d47cfeffc02a0fa621bd6641a8d39e75bb88cdc5ccf777194c774b4e May 21 02:07:45.119460 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.119405 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx"] May 21 02:07:45.121403 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.121371 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" May 21 02:07:45.123598 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.123571 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mgcfz\"" May 21 02:07:45.128454 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.128430 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx"] May 21 02:07:45.195729 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.195696 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" event={"ID":"05fc18aa-dbbd-4da2-88ab-4ff7aada0845","Type":"ContainerStarted","Data":"4bdbbd11d47cfeffc02a0fa621bd6641a8d39e75bb88cdc5ccf777194c774b4e"} May 21 02:07:45.200137 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.200111 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p8gk\" (UniqueName: \"kubernetes.io/projected/3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb-kube-api-access-7p8gk\") pod \"network-check-source-7f44b6dd87-dm2wx\" (UID: \"3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" May 21 02:07:45.300716 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.300672 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p8gk\" (UniqueName: \"kubernetes.io/projected/3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb-kube-api-access-7p8gk\") pod \"network-check-source-7f44b6dd87-dm2wx\" (UID: \"3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" May 21 02:07:45.310463 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.310439 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p8gk\" (UniqueName: \"kubernetes.io/projected/3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb-kube-api-access-7p8gk\") pod \"network-check-source-7f44b6dd87-dm2wx\" (UID: \"3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" May 21 02:07:45.433661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.433577 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" May 21 02:07:45.556290 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.556254 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx"] May 21 02:07:45.558664 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:07:45.558637 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdfa60d_e5d1_4303_86a3_f9638ff6a2eb.slice/crio-ef813e5b4fe07bd41f4125e968a31801ab62e47f639afba5eccf21630735b5c0 WatchSource:0}: Error finding container ef813e5b4fe07bd41f4125e968a31801ab62e47f639afba5eccf21630735b5c0: Status 404 returned error can't find the container with id ef813e5b4fe07bd41f4125e968a31801ab62e47f639afba5eccf21630735b5c0 May 21 02:07:45.797515 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.797481 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg"] May 21 02:07:45.800007 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.799982 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" May 21 02:07:45.802460 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.802436 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 02:07:45.802577 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.802481 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 02:07:45.802817 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.802782 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rzv86\"" May 21 02:07:45.809804 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.809780 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg"] May 21 02:07:45.906086 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.906045 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldgdw\" (UniqueName: \"kubernetes.io/projected/a7d9321d-d81f-428f-8cc3-2664b71bb63f-kube-api-access-ldgdw\") pod \"migrator-b985f5d89-grlxg\" (UID: \"a7d9321d-d81f-428f-8cc3-2664b71bb63f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" May 21 02:07:45.963968 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:45.963941 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhnnz_9c226802-7713-4756-8df1-ad0e72419838/dns-node-resolver/0.log" May 21 02:07:46.007342 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.007305 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldgdw\" (UniqueName: \"kubernetes.io/projected/a7d9321d-d81f-428f-8cc3-2664b71bb63f-kube-api-access-ldgdw\") pod \"migrator-b985f5d89-grlxg\" (UID: \"a7d9321d-d81f-428f-8cc3-2664b71bb63f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" May 21 02:07:46.015244 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.015218 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldgdw\" (UniqueName: \"kubernetes.io/projected/a7d9321d-d81f-428f-8cc3-2664b71bb63f-kube-api-access-ldgdw\") pod \"migrator-b985f5d89-grlxg\" (UID: \"a7d9321d-d81f-428f-8cc3-2664b71bb63f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" May 21 02:07:46.111484 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.111398 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" May 21 02:07:46.199759 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.199719 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" event={"ID":"3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb","Type":"ContainerStarted","Data":"9d0d427bedb13369ffcd5e134e49cd0ce7d1db9fb6e3a9752dce8262585ed94d"} May 21 02:07:46.199825 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.199772 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" event={"ID":"3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb","Type":"ContainerStarted","Data":"ef813e5b4fe07bd41f4125e968a31801ab62e47f639afba5eccf21630735b5c0"} May 21 02:07:46.213922 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.213839 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dm2wx" podStartSLOduration=1.213823007 podStartE2EDuration="1.213823007s" podCreationTimestamp="2026-05-21 02:07:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:07:46.213557882 +0000 UTC m=+119.976790270" watchObservedRunningTime="2026-05-21 02:07:46.213823007 +0000 UTC m=+119.977055397" May 21 02:07:46.298501 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.298469 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg"] May 21 02:07:46.303360 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:07:46.303329 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d9321d_d81f_428f_8cc3_2664b71bb63f.slice/crio-09a33339461b91098832d52dee1af7f9e031182ca4c1b09711e3aeeb683d8b09 WatchSource:0}: Error finding container 09a33339461b91098832d52dee1af7f9e031182ca4c1b09711e3aeeb683d8b09: Status 404 returned error can't find the container with id 09a33339461b91098832d52dee1af7f9e031182ca4c1b09711e3aeeb683d8b09 May 21 02:07:46.963647 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:46.963618 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7dcj_27df3f90-1575-48ea-93c0-0ea337913b1b/node-ca/0.log" May 21 02:07:47.203465 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:47.203428 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" event={"ID":"05fc18aa-dbbd-4da2-88ab-4ff7aada0845","Type":"ContainerStarted","Data":"c6129f22fc078cf2055620b3a95c853536c6a465124de0c6e82c93b16962b595"} May 21 02:07:47.204572 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:47.204542 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" event={"ID":"a7d9321d-d81f-428f-8cc3-2664b71bb63f","Type":"ContainerStarted","Data":"09a33339461b91098832d52dee1af7f9e031182ca4c1b09711e3aeeb683d8b09"} May 21 02:07:47.218210 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:47.218129 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" podStartSLOduration=2.284797828 podStartE2EDuration="4.218113998s" podCreationTimestamp="2026-05-21 02:07:43 +0000 UTC" firstStartedPulling="2026-05-21 02:07:44.267674739 +0000 UTC m=+118.030907105" lastFinishedPulling="2026-05-21 02:07:46.200990898 +0000 UTC m=+119.964223275" observedRunningTime="2026-05-21 02:07:47.216873558 +0000 UTC m=+120.980105943" watchObservedRunningTime="2026-05-21 02:07:47.218113998 +0000 UTC m=+120.981346385" May 21 02:07:47.723367 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:47.723276 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:47.723729 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:47.723436 2548 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:47.723729 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:47.723458 2548 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d99695-789jg: secret "image-registry-tls" not found May 21 02:07:47.723729 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:47.723513 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls podName:4d3bccdd-f1b0-457d-b82e-8e49d899a83b nodeName:}" failed. No retries permitted until 2026-05-21 02:07:55.723497454 +0000 UTC m=+129.486729818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls") pod "image-registry-599d99695-789jg" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b") : secret "image-registry-tls" not found May 21 02:07:48.208712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:48.208674 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" event={"ID":"a7d9321d-d81f-428f-8cc3-2664b71bb63f","Type":"ContainerStarted","Data":"c6c7fab4c73e93ddf9714b8c0fad8cab13e58a22ca9b1a55be4ba540f60c7b7e"} May 21 02:07:48.208712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:48.208712 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" event={"ID":"a7d9321d-d81f-428f-8cc3-2664b71bb63f","Type":"ContainerStarted","Data":"9babe963d8c5f41da70f36c3a74085f12b638054021ad17cbd30db6e2bf929fe"} May 21 02:07:48.223190 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:48.223137 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-grlxg" podStartSLOduration=2.125185801 podStartE2EDuration="3.223119284s" podCreationTimestamp="2026-05-21 02:07:45 +0000 UTC" firstStartedPulling="2026-05-21 02:07:46.306075846 +0000 UTC m=+120.069308210" lastFinishedPulling="2026-05-21 02:07:47.404009319 +0000 UTC m=+121.167241693" observedRunningTime="2026-05-21 02:07:48.222618966 +0000 UTC m=+121.985851356" watchObservedRunningTime="2026-05-21 02:07:48.223119284 +0000 UTC m=+121.986351671" May 21 02:07:50.488073 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.488033 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-psd7b"] May 21 02:07:50.490107 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.490081 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.492515 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.492494 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 02:07:50.492653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.492510 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 02:07:50.492653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.492533 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 02:07:50.492653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.492582 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 02:07:50.493732 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.493718 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sqr4m\"" May 21 02:07:50.497682 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.497660 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-psd7b"] May 21 02:07:50.646280 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.646245 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/189cb591-dd66-494c-9286-e518bc2e1005-signing-cabundle\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.646280 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.646280 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/189cb591-dd66-494c-9286-e518bc2e1005-signing-key\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.646474 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.646330 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9rl6\" (UniqueName: \"kubernetes.io/projected/189cb591-dd66-494c-9286-e518bc2e1005-kube-api-access-w9rl6\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.747264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.747176 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/189cb591-dd66-494c-9286-e518bc2e1005-signing-cabundle\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.747264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.747215 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/189cb591-dd66-494c-9286-e518bc2e1005-signing-key\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.747494 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.747279 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9rl6\" (UniqueName: \"kubernetes.io/projected/189cb591-dd66-494c-9286-e518bc2e1005-kube-api-access-w9rl6\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.747844 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.747820 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/189cb591-dd66-494c-9286-e518bc2e1005-signing-cabundle\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.749763 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.749730 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/189cb591-dd66-494c-9286-e518bc2e1005-signing-key\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.754700 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.754669 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9rl6\" (UniqueName: \"kubernetes.io/projected/189cb591-dd66-494c-9286-e518bc2e1005-kube-api-access-w9rl6\") pod \"service-ca-67d667c7d-psd7b\" (UID: \"189cb591-dd66-494c-9286-e518bc2e1005\") " pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.799300 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.799271 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-psd7b" May 21 02:07:50.918224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:50.918194 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-psd7b"] May 21 02:07:50.921162 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:07:50.921129 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189cb591_dd66_494c_9286_e518bc2e1005.slice/crio-90ef28548fae5ac082e40ade45e7bc47b0c7f28a628f912007ef70cca4962bba WatchSource:0}: Error finding container 90ef28548fae5ac082e40ade45e7bc47b0c7f28a628f912007ef70cca4962bba: Status 404 returned error can't find the container with id 90ef28548fae5ac082e40ade45e7bc47b0c7f28a628f912007ef70cca4962bba May 21 02:07:51.217593 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:51.217506 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-psd7b" event={"ID":"189cb591-dd66-494c-9286-e518bc2e1005","Type":"ContainerStarted","Data":"1a888ccd85601ef0127915983b6065acd4e8bc530eeeb2c6ba43981cbcddd861"} May 21 02:07:51.217593 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:51.217553 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-psd7b" event={"ID":"189cb591-dd66-494c-9286-e518bc2e1005","Type":"ContainerStarted","Data":"90ef28548fae5ac082e40ade45e7bc47b0c7f28a628f912007ef70cca4962bba"} May 21 02:07:51.234406 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:51.234350 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-psd7b" podStartSLOduration=1.234331018 podStartE2EDuration="1.234331018s" podCreationTimestamp="2026-05-21 02:07:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:07:51.232991593 +0000 UTC m=+124.996223980" watchObservedRunningTime="2026-05-21 02:07:51.234331018 +0000 UTC m=+124.997563404" May 21 02:07:55.788321 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:55.788284 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") pod \"image-registry-599d99695-789jg\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:07:55.788711 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:55.788443 2548 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 02:07:55.788711 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:55.788467 2548 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d99695-789jg: secret "image-registry-tls" not found May 21 02:07:55.788711 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:55.788535 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls podName:4d3bccdd-f1b0-457d-b82e-8e49d899a83b nodeName:}" failed. No retries permitted until 2026-05-21 02:08:11.788514392 +0000 UTC m=+145.551746770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls") pod "image-registry-599d99695-789jg" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b") : secret "image-registry-tls" not found May 21 02:07:56.596171 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:07:56.596126 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:07:56.596355 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:56.596254 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 02:07:56.596355 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:07:56.596308 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs podName:8dc202d3-7440-4df8-96f2-09c3248bcacb nodeName:}" failed. No retries permitted until 2026-05-21 02:09:58.596293612 +0000 UTC m=+252.359525975 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs") pod "network-metrics-daemon-j4nwr" (UID: "8dc202d3-7440-4df8-96f2-09c3248bcacb") : secret "metrics-daemon-secret" not found May 21 02:08:09.335390 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.335353 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-599d99695-789jg"] May 21 02:08:09.335813 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:09.335581 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-599d99695-789jg" podUID="4d3bccdd-f1b0-457d-b82e-8e49d899a83b" May 21 02:08:09.402952 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.402919 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g8qrq"] May 21 02:08:09.405182 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.405158 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.407518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.407495 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 02:08:09.407599 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.407501 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5xl8\"" May 21 02:08:09.407649 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.407632 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 02:08:09.416126 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.416103 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g8qrq"] May 21 02:08:09.495191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.495151 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsw8c\" (UniqueName: \"kubernetes.io/projected/8d492a1c-0251-4404-b74b-68e09af214d8-kube-api-access-fsw8c\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.495191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.495192 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d492a1c-0251-4404-b74b-68e09af214d8-data-volume\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.495404 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.495208 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d492a1c-0251-4404-b74b-68e09af214d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.495404 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.495289 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d492a1c-0251-4404-b74b-68e09af214d8-crio-socket\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.495404 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.495337 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d492a1c-0251-4404-b74b-68e09af214d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.595766 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.595651 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d492a1c-0251-4404-b74b-68e09af214d8-crio-socket\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.595766 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.595706 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d492a1c-0251-4404-b74b-68e09af214d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.595987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.595791 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsw8c\" (UniqueName: \"kubernetes.io/projected/8d492a1c-0251-4404-b74b-68e09af214d8-kube-api-access-fsw8c\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.595987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.595797 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d492a1c-0251-4404-b74b-68e09af214d8-crio-socket\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.595987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.595825 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d492a1c-0251-4404-b74b-68e09af214d8-data-volume\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.595987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.595851 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d492a1c-0251-4404-b74b-68e09af214d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.596252 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.596230 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d492a1c-0251-4404-b74b-68e09af214d8-data-volume\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.596354 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.596284 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d492a1c-0251-4404-b74b-68e09af214d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.598230 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.598208 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d492a1c-0251-4404-b74b-68e09af214d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.605414 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.605393 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsw8c\" (UniqueName: \"kubernetes.io/projected/8d492a1c-0251-4404-b74b-68e09af214d8-kube-api-access-fsw8c\") pod \"insights-runtime-extractor-g8qrq\" (UID: \"8d492a1c-0251-4404-b74b-68e09af214d8\") " pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.714487 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.714437 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g8qrq" May 21 02:08:09.836158 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:09.836127 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g8qrq"] May 21 02:08:09.840278 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:09.840250 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d492a1c_0251_4404_b74b_68e09af214d8.slice/crio-51ce78905f01f64ad988ca1d620f03b60afc11456db1a3de6db66967c4446e87 WatchSource:0}: Error finding container 51ce78905f01f64ad988ca1d620f03b60afc11456db1a3de6db66967c4446e87: Status 404 returned error can't find the container with id 51ce78905f01f64ad988ca1d620f03b60afc11456db1a3de6db66967c4446e87 May 21 02:08:10.270057 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.270027 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:08:10.270057 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.270037 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8qrq" event={"ID":"8d492a1c-0251-4404-b74b-68e09af214d8","Type":"ContainerStarted","Data":"fb6efb781fbbac5b0397ecb6b20f0aa507f57a5c7977f6bf4d274c7b8ca2da8b"} May 21 02:08:10.270262 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.270068 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8qrq" event={"ID":"8d492a1c-0251-4404-b74b-68e09af214d8","Type":"ContainerStarted","Data":"51ce78905f01f64ad988ca1d620f03b60afc11456db1a3de6db66967c4446e87"} May 21 02:08:10.274129 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.274105 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:08:10.302239 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302207 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-installation-pull-secrets\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302376 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302245 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-image-registry-private-configuration\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302376 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302265 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-ca-trust-extracted\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302376 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302293 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7869n\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-kube-api-access-7869n\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302376 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302340 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-certificates\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302376 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302360 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-bound-sa-token\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302624 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302418 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-trusted-ca\") pod \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\" (UID: \"4d3bccdd-f1b0-457d-b82e-8e49d899a83b\") " May 21 02:08:10.302674 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302633 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:08:10.302846 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302819 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:08:10.302964 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.302948 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:08:10.304552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.304531 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:08:10.304552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.304536 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:08:10.304855 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.304832 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:08:10.304855 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.304843 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-kube-api-access-7869n" (OuterVolumeSpecName: "kube-api-access-7869n") pod "4d3bccdd-f1b0-457d-b82e-8e49d899a83b" (UID: "4d3bccdd-f1b0-457d-b82e-8e49d899a83b"). InnerVolumeSpecName "kube-api-access-7869n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:08:10.403079 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403036 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-trusted-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:10.403079 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403080 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-installation-pull-secrets\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:10.403490 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403094 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-image-registry-private-configuration\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:10.403490 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403107 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-ca-trust-extracted\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:10.403490 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403121 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7869n\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-kube-api-access-7869n\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:10.403490 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403136 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-certificates\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:10.403490 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:10.403149 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-bound-sa-token\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:11.278189 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:11.278150 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8qrq" event={"ID":"8d492a1c-0251-4404-b74b-68e09af214d8","Type":"ContainerStarted","Data":"e188d2587ed3eb4c94d507c97d41124e59405d6c07968bde81347eb870221a50"} May 21 02:08:11.278371 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:11.278222 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d99695-789jg" May 21 02:08:11.306467 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:11.306414 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-599d99695-789jg"] May 21 02:08:11.316690 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:11.316658 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-599d99695-789jg"] May 21 02:08:11.411466 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:11.411432 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d3bccdd-f1b0-457d-b82e-8e49d899a83b-registry-tls\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:12.854027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:12.853996 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d3bccdd-f1b0-457d-b82e-8e49d899a83b" path="/var/lib/kubelet/pods/4d3bccdd-f1b0-457d-b82e-8e49d899a83b/volumes" May 21 02:08:13.285096 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:13.285054 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8qrq" event={"ID":"8d492a1c-0251-4404-b74b-68e09af214d8","Type":"ContainerStarted","Data":"6cb5abf0f3dd984a665f63586c78d39daf47f915e8728aa460c652cdad185b6c"} May 21 02:08:13.302083 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:13.302035 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g8qrq" podStartSLOduration=1.941972894 podStartE2EDuration="4.30202029s" podCreationTimestamp="2026-05-21 02:08:09 +0000 UTC" firstStartedPulling="2026-05-21 02:08:09.886411596 +0000 UTC m=+143.649643973" lastFinishedPulling="2026-05-21 02:08:12.246458991 +0000 UTC m=+146.009691369" observedRunningTime="2026-05-21 02:08:13.301343975 +0000 UTC m=+147.064576385" watchObservedRunningTime="2026-05-21 02:08:13.30202029 +0000 UTC m=+147.065252675" May 21 02:08:14.409113 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.409067 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd5f996f7-9qhwd"] May 21 02:08:14.412026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.412002 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.414334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.414312 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 02:08:14.415410 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415387 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 02:08:14.415410 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415389 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 02:08:14.415573 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415442 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 02:08:14.415573 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415392 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 02:08:14.415573 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415412 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 02:08:14.415573 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415508 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-58r48\"" May 21 02:08:14.415780 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.415628 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 02:08:14.422938 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.422914 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd5f996f7-9qhwd"] May 21 02:08:14.435129 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.435105 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-oauth-serving-cert\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.435246 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.435142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-config\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.435246 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.435170 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-service-ca\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.435327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.435244 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsbn\" (UniqueName: \"kubernetes.io/projected/5198bcfb-d9eb-4802-937a-d9abb70402dc-kube-api-access-7hsbn\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.435327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.435264 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-serving-cert\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.435327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.435303 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-oauth-config\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.535986 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.535947 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsbn\" (UniqueName: \"kubernetes.io/projected/5198bcfb-d9eb-4802-937a-d9abb70402dc-kube-api-access-7hsbn\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.535986 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.535985 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-serving-cert\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536225 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536031 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-oauth-config\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536225 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536052 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-oauth-serving-cert\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536225 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536074 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-config\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536225 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536098 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-service-ca\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536864 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536836 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-service-ca\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536998 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536936 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-config\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.536998 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.536972 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-oauth-serving-cert\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.538496 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.538477 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-oauth-config\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.538600 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.538582 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-serving-cert\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.543419 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.543392 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsbn\" (UniqueName: \"kubernetes.io/projected/5198bcfb-d9eb-4802-937a-d9abb70402dc-kube-api-access-7hsbn\") pod \"console-cd5f996f7-9qhwd\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.720886 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.720785 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:14.854774 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.854730 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd5f996f7-9qhwd"] May 21 02:08:14.857561 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:14.857531 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5198bcfb_d9eb_4802_937a_d9abb70402dc.slice/crio-46b7bccfdf7f1baccd0e4683b340b2afdc95db445fa0a6bbc86415f865972bd8 WatchSource:0}: Error finding container 46b7bccfdf7f1baccd0e4683b340b2afdc95db445fa0a6bbc86415f865972bd8: Status 404 returned error can't find the container with id 46b7bccfdf7f1baccd0e4683b340b2afdc95db445fa0a6bbc86415f865972bd8 May 21 02:08:14.957149 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.957115 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49"] May 21 02:08:14.959632 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.959615 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:14.962564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.962543 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 02:08:14.962980 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:14.962966 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2b2c9\"" May 21 02:08:15.021620 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.021567 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49"] May 21 02:08:15.039536 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.039500 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e94c5b0-62df-4a74-a81e-54a0a2714c96-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-x9f49\" (UID: \"9e94c5b0-62df-4a74-a81e-54a0a2714c96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:15.140016 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.139971 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e94c5b0-62df-4a74-a81e-54a0a2714c96-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-x9f49\" (UID: \"9e94c5b0-62df-4a74-a81e-54a0a2714c96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:15.140207 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:15.140119 2548 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 02:08:15.140207 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:15.140186 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e94c5b0-62df-4a74-a81e-54a0a2714c96-tls-certificates podName:9e94c5b0-62df-4a74-a81e-54a0a2714c96 nodeName:}" failed. No retries permitted until 2026-05-21 02:08:15.640170532 +0000 UTC m=+149.403402895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9e94c5b0-62df-4a74-a81e-54a0a2714c96-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" (UID: "9e94c5b0-62df-4a74-a81e-54a0a2714c96") : secret "prometheus-operator-admission-webhook-tls" not found May 21 02:08:15.290848 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.290761 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd5f996f7-9qhwd" event={"ID":"5198bcfb-d9eb-4802-937a-d9abb70402dc","Type":"ContainerStarted","Data":"46b7bccfdf7f1baccd0e4683b340b2afdc95db445fa0a6bbc86415f865972bd8"} May 21 02:08:15.642989 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.642885 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e94c5b0-62df-4a74-a81e-54a0a2714c96-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-x9f49\" (UID: \"9e94c5b0-62df-4a74-a81e-54a0a2714c96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:15.645712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.645678 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e94c5b0-62df-4a74-a81e-54a0a2714c96-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-x9f49\" (UID: \"9e94c5b0-62df-4a74-a81e-54a0a2714c96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:15.869470 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.869421 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:16.000013 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:15.999976 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49"] May 21 02:08:16.003577 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:16.003545 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e94c5b0_62df_4a74_a81e_54a0a2714c96.slice/crio-84e6830be69eecce8bb71778b0f2277b882e5a00c2d0edb9678b5009dce1972c WatchSource:0}: Error finding container 84e6830be69eecce8bb71778b0f2277b882e5a00c2d0edb9678b5009dce1972c: Status 404 returned error can't find the container with id 84e6830be69eecce8bb71778b0f2277b882e5a00c2d0edb9678b5009dce1972c May 21 02:08:16.294903 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:16.294861 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" event={"ID":"9e94c5b0-62df-4a74-a81e-54a0a2714c96","Type":"ContainerStarted","Data":"84e6830be69eecce8bb71778b0f2277b882e5a00c2d0edb9678b5009dce1972c"} May 21 02:08:18.302179 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:18.302141 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd5f996f7-9qhwd" event={"ID":"5198bcfb-d9eb-4802-937a-d9abb70402dc","Type":"ContainerStarted","Data":"fe3822c4250128d5ff4d6d4f304c251a193e3a5d3bbdd858e3c31f7fcebdc34e"} May 21 02:08:18.303466 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:18.303439 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" event={"ID":"9e94c5b0-62df-4a74-a81e-54a0a2714c96","Type":"ContainerStarted","Data":"cf3cd2bfd9637a77fac75c51c1e74961e4a33c8d318b584852566dc97c721116"} May 21 02:08:18.303640 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:18.303624 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:18.308317 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:18.308292 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" May 21 02:08:18.318182 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:18.318142 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-cd5f996f7-9qhwd" podStartSLOduration=1.080617566 podStartE2EDuration="4.31812846s" podCreationTimestamp="2026-05-21 02:08:14 +0000 UTC" firstStartedPulling="2026-05-21 02:08:14.859388788 +0000 UTC m=+148.622621151" lastFinishedPulling="2026-05-21 02:08:18.096899679 +0000 UTC m=+151.860132045" observedRunningTime="2026-05-21 02:08:18.316825093 +0000 UTC m=+152.080057477" watchObservedRunningTime="2026-05-21 02:08:18.31812846 +0000 UTC m=+152.081360845" May 21 02:08:18.330067 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:18.330025 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-x9f49" podStartSLOduration=2.244546943 podStartE2EDuration="4.330012203s" podCreationTimestamp="2026-05-21 02:08:14 +0000 UTC" firstStartedPulling="2026-05-21 02:08:16.005948179 +0000 UTC m=+149.769180542" lastFinishedPulling="2026-05-21 02:08:18.091413425 +0000 UTC m=+151.854645802" observedRunningTime="2026-05-21 02:08:18.329636344 +0000 UTC m=+152.092868729" watchObservedRunningTime="2026-05-21 02:08:18.330012203 +0000 UTC m=+152.093244589" May 21 02:08:19.015736 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.015699 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5"] May 21 02:08:19.017945 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.017929 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.020274 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.020242 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 02:08:19.020274 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.020275 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 02:08:19.021358 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.021337 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dhjkc\"" May 21 02:08:19.021358 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.021348 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 02:08:19.021539 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.021376 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 02:08:19.021611 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.021597 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 02:08:19.026997 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.026971 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5"] May 21 02:08:19.076002 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.075953 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.076002 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.076006 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e219106-e1f5-4569-b3b8-0f40c9df9f84-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.076213 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.076064 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtmd\" (UniqueName: \"kubernetes.io/projected/7e219106-e1f5-4569-b3b8-0f40c9df9f84-kube-api-access-smtmd\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.076213 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.076163 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.176906 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.176864 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.176906 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.176913 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e219106-e1f5-4569-b3b8-0f40c9df9f84-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.177132 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:19.177020 2548 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 02:08:19.177132 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.177101 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smtmd\" (UniqueName: \"kubernetes.io/projected/7e219106-e1f5-4569-b3b8-0f40c9df9f84-kube-api-access-smtmd\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.177241 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:19.177223 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-tls podName:7e219106-e1f5-4569-b3b8-0f40c9df9f84 nodeName:}" failed. No retries permitted until 2026-05-21 02:08:19.67719034 +0000 UTC m=+153.440422715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-gqbv5" (UID: "7e219106-e1f5-4569-b3b8-0f40c9df9f84") : secret "prometheus-operator-tls" not found May 21 02:08:19.177291 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.177267 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.177638 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.177618 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e219106-e1f5-4569-b3b8-0f40c9df9f84-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.179588 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.179564 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.187037 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.187012 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtmd\" (UniqueName: \"kubernetes.io/projected/7e219106-e1f5-4569-b3b8-0f40c9df9f84-kube-api-access-smtmd\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.683336 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.683293 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.685758 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.685717 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e219106-e1f5-4569-b3b8-0f40c9df9f84-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gqbv5\" (UID: \"7e219106-e1f5-4569-b3b8-0f40c9df9f84\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:19.932359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:19.932325 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" May 21 02:08:20.052144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:20.052112 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5"] May 21 02:08:20.055108 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:20.055077 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e219106_e1f5_4569_b3b8_0f40c9df9f84.slice/crio-14e9bf7c4aefa985f6289d0e691fb125074d8b085c7771fab6889a0ef18cc3e8 WatchSource:0}: Error finding container 14e9bf7c4aefa985f6289d0e691fb125074d8b085c7771fab6889a0ef18cc3e8: Status 404 returned error can't find the container with id 14e9bf7c4aefa985f6289d0e691fb125074d8b085c7771fab6889a0ef18cc3e8 May 21 02:08:20.310059 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:20.310023 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" event={"ID":"7e219106-e1f5-4569-b3b8-0f40c9df9f84","Type":"ContainerStarted","Data":"14e9bf7c4aefa985f6289d0e691fb125074d8b085c7771fab6889a0ef18cc3e8"} May 21 02:08:22.316965 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:22.316932 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" event={"ID":"7e219106-e1f5-4569-b3b8-0f40c9df9f84","Type":"ContainerStarted","Data":"d0fef46dc9851884e2a07b90a3c92bf08f8d19a27df86d8a4f332b501d98a5d2"} May 21 02:08:22.316965 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:22.316971 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" event={"ID":"7e219106-e1f5-4569-b3b8-0f40c9df9f84","Type":"ContainerStarted","Data":"533ca1e80fa8660947ffa35882e9f73e736b3c1b5b000f4ecb0dae7ccfd78893"} May 21 02:08:22.333160 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:22.333109 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gqbv5" podStartSLOduration=2.9544545319999997 podStartE2EDuration="4.333066267s" podCreationTimestamp="2026-05-21 02:08:18 +0000 UTC" firstStartedPulling="2026-05-21 02:08:20.056898396 +0000 UTC m=+153.820130759" lastFinishedPulling="2026-05-21 02:08:21.435510127 +0000 UTC m=+155.198742494" observedRunningTime="2026-05-21 02:08:22.331833456 +0000 UTC m=+156.095065856" watchObservedRunningTime="2026-05-21 02:08:22.333066267 +0000 UTC m=+156.096298652" May 21 02:08:23.134139 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:23.134098 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kpkrw" podUID="11211a5d-656f-4fc7-bad2-06a89a7a761a" May 21 02:08:23.144293 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:23.144263 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-sh86t" podUID="ca558918-82a6-4677-9d2b-05304be9cf29" May 21 02:08:23.319191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:23.319156 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpkrw" May 21 02:08:23.876197 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:23.876140 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-j4nwr" podUID="8dc202d3-7440-4df8-96f2-09c3248bcacb" May 21 02:08:24.349460 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.349427 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-67brb"] May 21 02:08:24.352940 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.352912 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr"] May 21 02:08:24.353051 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.352958 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.355638 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.355557 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 02:08:24.355792 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.355685 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 02:08:24.355792 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.355772 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fqhr4\"" May 21 02:08:24.356379 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.356357 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.358481 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.358462 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lb8xk\"" May 21 02:08:24.358688 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.358674 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 02:08:24.358811 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.358794 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 02:08:24.359518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.359499 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 02:08:24.361844 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.361811 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-67brb"] May 21 02:08:24.365193 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.365168 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr"] May 21 02:08:24.377688 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.377667 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d8cwq"] May 21 02:08:24.381410 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.381393 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.385388 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.385368 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 02:08:24.385473 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.385367 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 02:08:24.385983 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.385965 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 02:08:24.386150 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.386132 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w4qsv\"" May 21 02:08:24.420511 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.420672 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420517 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbhrw\" (UniqueName: \"kubernetes.io/projected/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-api-access-qbhrw\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.420672 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420545 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.420672 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420564 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.420672 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420655 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72d3e1d4-7220-4023-bdc2-07a67cfad747-metrics-client-ca\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.420895 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420695 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.420895 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420725 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-tls\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.420895 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420794 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlztn\" (UniqueName: \"kubernetes.io/projected/c464c525-a51d-48b5-8ef4-4304ed6f1902-kube-api-access-dlztn\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.420895 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420828 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c464c525-a51d-48b5-8ef4-4304ed6f1902-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.421077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420895 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bb8aa146-d4b8-48e4-a555-117ea71340c6-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.421077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-wtmp\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.421077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420941 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.421077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.420959 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vsf\" (UniqueName: \"kubernetes.io/projected/72d3e1d4-7220-4023-bdc2-07a67cfad747-kube-api-access-p8vsf\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.421077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.421010 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.421077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.421055 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.421375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.421097 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-sys\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.421375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.421113 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-textfile\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.421375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.421129 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-root\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.421375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.421143 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb8aa146-d4b8-48e4-a555-117ea71340c6-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.521884 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.521850 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.521884 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.521890 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbhrw\" (UniqueName: \"kubernetes.io/projected/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-api-access-qbhrw\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.522151 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.521916 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.522151 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.521934 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.522151 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522063 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72d3e1d4-7220-4023-bdc2-07a67cfad747-metrics-client-ca\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.522405 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522096 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.522470 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522452 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-tls\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.522617 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:24.522600 2548 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 02:08:24.522695 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522667 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.522899 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:24.522681 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-tls podName:72d3e1d4-7220-4023-bdc2-07a67cfad747 nodeName:}" failed. No retries permitted until 2026-05-21 02:08:25.022659823 +0000 UTC m=+158.785892188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-tls") pod "node-exporter-d8cwq" (UID: "72d3e1d4-7220-4023-bdc2-07a67cfad747") : secret "node-exporter-tls" not found May 21 02:08:24.522899 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522697 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.523027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522949 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlztn\" (UniqueName: \"kubernetes.io/projected/c464c525-a51d-48b5-8ef4-4304ed6f1902-kube-api-access-dlztn\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.523027 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.522986 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c464c525-a51d-48b5-8ef4-4304ed6f1902-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.523167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523145 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72d3e1d4-7220-4023-bdc2-07a67cfad747-metrics-client-ca\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.523238 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523215 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bb8aa146-d4b8-48e4-a555-117ea71340c6-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.523293 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523252 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-wtmp\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.523352 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523294 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.523352 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523321 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vsf\" (UniqueName: \"kubernetes.io/projected/72d3e1d4-7220-4023-bdc2-07a67cfad747-kube-api-access-p8vsf\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.523461 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523371 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.523461 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523434 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-wtmp\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.523795 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523772 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bb8aa146-d4b8-48e4-a555-117ea71340c6-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.523934 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:24.523788 2548 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 21 02:08:24.524033 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:08:24.523991 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-tls podName:c464c525-a51d-48b5-8ef4-4304ed6f1902 nodeName:}" failed. No retries permitted until 2026-05-21 02:08:25.02397246 +0000 UTC m=+158.787204826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-67brb" (UID: "c464c525-a51d-48b5-8ef4-4304ed6f1902") : secret "openshift-state-metrics-tls" not found May 21 02:08:24.524033 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.523673 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524033 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524005 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c464c525-a51d-48b5-8ef4-4304ed6f1902-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.524199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524049 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-sys\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524078 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-textfile\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524104 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-root\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524130 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb8aa146-d4b8-48e4-a555-117ea71340c6-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.524199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524138 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-sys\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524455 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524213 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72d3e1d4-7220-4023-bdc2-07a67cfad747-root\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524504 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524474 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-textfile\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.524950 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.524929 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb8aa146-d4b8-48e4-a555-117ea71340c6-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.525075 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.525001 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.525518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.525497 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.526114 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.526092 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.526561 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.526541 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.531198 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.531174 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlztn\" (UniqueName: \"kubernetes.io/projected/c464c525-a51d-48b5-8ef4-4304ed6f1902-kube-api-access-dlztn\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:24.531924 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.531889 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vsf\" (UniqueName: \"kubernetes.io/projected/72d3e1d4-7220-4023-bdc2-07a67cfad747-kube-api-access-p8vsf\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:24.532003 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.531969 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbhrw\" (UniqueName: \"kubernetes.io/projected/bb8aa146-d4b8-48e4-a555-117ea71340c6-kube-api-access-qbhrw\") pod \"kube-state-metrics-54fd6bc5c4-xtcpr\" (UID: \"bb8aa146-d4b8-48e4-a555-117ea71340c6\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.676104 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.676008 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" May 21 02:08:24.722447 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.722138 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:24.722447 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.722443 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:24.723479 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.723442 2548 patch_prober.go:28] interesting pod/console-cd5f996f7-9qhwd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= May 21 02:08:24.723588 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.723493 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cd5f996f7-9qhwd" podUID="5198bcfb-d9eb-4802-937a-d9abb70402dc" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" May 21 02:08:24.807368 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:24.807336 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr"] May 21 02:08:24.810508 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:24.810482 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8aa146_d4b8_48e4_a555_117ea71340c6.slice/crio-cdf60e4604740e8b199e9470b3c1856776669b2414bb9c7bc5eb28d9053a56dd WatchSource:0}: Error finding container cdf60e4604740e8b199e9470b3c1856776669b2414bb9c7bc5eb28d9053a56dd: Status 404 returned error can't find the container with id cdf60e4604740e8b199e9470b3c1856776669b2414bb9c7bc5eb28d9053a56dd May 21 02:08:25.029312 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.029281 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-tls\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:25.029499 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.029381 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:25.031605 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.031573 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72d3e1d4-7220-4023-bdc2-07a67cfad747-node-exporter-tls\") pod \"node-exporter-d8cwq\" (UID: \"72d3e1d4-7220-4023-bdc2-07a67cfad747\") " pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:25.031698 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.031645 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c464c525-a51d-48b5-8ef4-4304ed6f1902-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-67brb\" (UID: \"c464c525-a51d-48b5-8ef4-4304ed6f1902\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:25.198614 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.198571 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d87f9d849-mj9s2"] May 21 02:08:25.203109 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.203085 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.210185 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.210116 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 02:08:25.212190 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.212168 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d87f9d849-mj9s2"] May 21 02:08:25.265589 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.265558 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" May 21 02:08:25.292631 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.292556 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8cwq" May 21 02:08:25.306026 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:25.305573 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d3e1d4_7220_4023_bdc2_07a67cfad747.slice/crio-b24d11d11cf703e622312470b60839d10233a14183e1043f8a0ed8d126a2afe1 WatchSource:0}: Error finding container b24d11d11cf703e622312470b60839d10233a14183e1043f8a0ed8d126a2afe1: Status 404 returned error can't find the container with id b24d11d11cf703e622312470b60839d10233a14183e1043f8a0ed8d126a2afe1 May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331003 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-config\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331052 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-oauth-serving-cert\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331082 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj776\" (UniqueName: \"kubernetes.io/projected/491fd9ad-24a3-46c0-9522-4ac9af41ebac-kube-api-access-xj776\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331126 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-trusted-ca-bundle\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331160 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-service-ca\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331252 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-serving-cert\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331377 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331302 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-oauth-config\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.331856 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.331490 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8cwq" event={"ID":"72d3e1d4-7220-4023-bdc2-07a67cfad747","Type":"ContainerStarted","Data":"b24d11d11cf703e622312470b60839d10233a14183e1043f8a0ed8d126a2afe1"} May 21 02:08:25.332658 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.332616 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" event={"ID":"bb8aa146-d4b8-48e4-a555-117ea71340c6","Type":"ContainerStarted","Data":"cdf60e4604740e8b199e9470b3c1856776669b2414bb9c7bc5eb28d9053a56dd"} May 21 02:08:25.396720 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.396695 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-67brb"] May 21 02:08:25.399404 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:25.399377 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc464c525_a51d_48b5_8ef4_4304ed6f1902.slice/crio-4704a7e690ea6e189a41df41199da82596fe486f4d85acedd65e3c104570560c WatchSource:0}: Error finding container 4704a7e690ea6e189a41df41199da82596fe486f4d85acedd65e3c104570560c: Status 404 returned error can't find the container with id 4704a7e690ea6e189a41df41199da82596fe486f4d85acedd65e3c104570560c May 21 02:08:25.433760 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.433712 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-oauth-serving-cert\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.433875 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.433779 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj776\" (UniqueName: \"kubernetes.io/projected/491fd9ad-24a3-46c0-9522-4ac9af41ebac-kube-api-access-xj776\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.433875 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.433845 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-trusted-ca-bundle\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.433875 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.433870 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-service-ca\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.434020 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.433977 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-serving-cert\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.434082 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.434040 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-oauth-config\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.434156 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.434134 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-config\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.434449 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.434421 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-oauth-serving-cert\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.436304 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.435191 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-service-ca\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.436304 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.435838 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-config\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.436304 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.436275 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-trusted-ca-bundle\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.436937 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.436909 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-serving-cert\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.437137 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.437118 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-oauth-config\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.449723 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.449698 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj776\" (UniqueName: \"kubernetes.io/projected/491fd9ad-24a3-46c0-9522-4ac9af41ebac-kube-api-access-xj776\") pod \"console-5d87f9d849-mj9s2\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.514478 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.514450 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:25.657853 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:25.657810 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d87f9d849-mj9s2"] May 21 02:08:25.661106 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:25.661074 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491fd9ad_24a3_46c0_9522_4ac9af41ebac.slice/crio-aea52934b30080866bc8a64026f8e47f8b1968e573f555247fef47dc8f70833f WatchSource:0}: Error finding container aea52934b30080866bc8a64026f8e47f8b1968e573f555247fef47dc8f70833f: Status 404 returned error can't find the container with id aea52934b30080866bc8a64026f8e47f8b1968e573f555247fef47dc8f70833f May 21 02:08:26.335811 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.335317 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd"] May 21 02:08:26.339796 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.339763 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d87f9d849-mj9s2" event={"ID":"491fd9ad-24a3-46c0-9522-4ac9af41ebac","Type":"ContainerStarted","Data":"bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006"} May 21 02:08:26.339796 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.339799 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d87f9d849-mj9s2" event={"ID":"491fd9ad-24a3-46c0-9522-4ac9af41ebac","Type":"ContainerStarted","Data":"aea52934b30080866bc8a64026f8e47f8b1968e573f555247fef47dc8f70833f"} May 21 02:08:26.339965 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.339815 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" event={"ID":"c464c525-a51d-48b5-8ef4-4304ed6f1902","Type":"ContainerStarted","Data":"11f57a7bc0ac6e90793532da78fbeacc7f08d3a1eceb49c3ab5882f88a17c946"} May 21 02:08:26.339965 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.339828 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" event={"ID":"c464c525-a51d-48b5-8ef4-4304ed6f1902","Type":"ContainerStarted","Data":"264e2ddad3f815b81ff43271cae7fd357640a66425ea557923e5e70b7d11fdfb"} May 21 02:08:26.339965 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.339841 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" event={"ID":"c464c525-a51d-48b5-8ef4-4304ed6f1902","Type":"ContainerStarted","Data":"4704a7e690ea6e189a41df41199da82596fe486f4d85acedd65e3c104570560c"} May 21 02:08:26.340087 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.339994 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.342011 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.341984 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 02:08:26.342564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.342325 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 02:08:26.342564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.342349 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 02:08:26.342564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.342417 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 02:08:26.342564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.342448 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 02:08:26.342564 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.342453 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3lqmk136n01k\"" May 21 02:08:26.342937 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.342919 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-55h94\"" May 21 02:08:26.348371 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.348352 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd"] May 21 02:08:26.359763 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.359690 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d87f9d849-mj9s2" podStartSLOduration=1.359675022 podStartE2EDuration="1.359675022s" podCreationTimestamp="2026-05-21 02:08:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:08:26.359199821 +0000 UTC m=+160.122432205" watchObservedRunningTime="2026-05-21 02:08:26.359675022 +0000 UTC m=+160.122907407" May 21 02:08:26.444723 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.444680 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.444733 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.444870 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e04fcda-7372-480e-8e40-6cb9be801659-metrics-client-ca\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.444916 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-tls\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.444990 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-grpc-tls\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.445011 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.445049 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.445201 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.445144 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlxhd\" (UniqueName: \"kubernetes.io/projected/4e04fcda-7372-480e-8e40-6cb9be801659-kube-api-access-jlxhd\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.545618 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.545583 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.545618 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.545627 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.545883 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.545854 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e04fcda-7372-480e-8e40-6cb9be801659-metrics-client-ca\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.546026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.545924 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-tls\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.546026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.545971 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-grpc-tls\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.546026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.546003 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.546202 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.546037 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.546202 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.546091 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxhd\" (UniqueName: \"kubernetes.io/projected/4e04fcda-7372-480e-8e40-6cb9be801659-kube-api-access-jlxhd\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.546739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.546615 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e04fcda-7372-480e-8e40-6cb9be801659-metrics-client-ca\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.548888 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.548828 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.549022 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.548997 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.549264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.549229 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-grpc-tls\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.549469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.549438 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-tls\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.549469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.549449 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.549583 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.549548 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e04fcda-7372-480e-8e40-6cb9be801659-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.553692 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.553668 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxhd\" (UniqueName: \"kubernetes.io/projected/4e04fcda-7372-480e-8e40-6cb9be801659-kube-api-access-jlxhd\") pod \"thanos-querier-5b67b96fb7-q2bnd\" (UID: \"4e04fcda-7372-480e-8e40-6cb9be801659\") " pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.651917 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.651823 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:26.911079 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:26.911055 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd"] May 21 02:08:26.915792 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:26.915740 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e04fcda_7372_480e_8e40_6cb9be801659.slice/crio-78cff920d8fcefd199f4ee2b9fde7dc37da0ea451c49f6c7933b6d411b82f763 WatchSource:0}: Error finding container 78cff920d8fcefd199f4ee2b9fde7dc37da0ea451c49f6c7933b6d411b82f763: Status 404 returned error can't find the container with id 78cff920d8fcefd199f4ee2b9fde7dc37da0ea451c49f6c7933b6d411b82f763 May 21 02:08:27.344076 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.344040 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" event={"ID":"bb8aa146-d4b8-48e4-a555-117ea71340c6","Type":"ContainerStarted","Data":"618dc553b61e98d4e49a6ac4ae79ab164758a4dd98f250071cdd06b888b730ad"} May 21 02:08:27.344266 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.344085 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" event={"ID":"bb8aa146-d4b8-48e4-a555-117ea71340c6","Type":"ContainerStarted","Data":"dc2303ed3fee2254ec2c93e85123ffd0201bb0200a85a6534baeff4fbcdb613f"} May 21 02:08:27.344266 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.344098 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" event={"ID":"bb8aa146-d4b8-48e4-a555-117ea71340c6","Type":"ContainerStarted","Data":"e43908ccbd0a269267dcdc32bba802b3ff29f8a828c9a5ee5e30c42bd1971a67"} May 21 02:08:27.345962 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.345932 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" event={"ID":"c464c525-a51d-48b5-8ef4-4304ed6f1902","Type":"ContainerStarted","Data":"93c28579b72a31313533a7c7ce988009255a294aff8dc468ecb20e881266c7c8"} May 21 02:08:27.347414 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.347387 2548 generic.go:358] "Generic (PLEG): container finished" podID="72d3e1d4-7220-4023-bdc2-07a67cfad747" containerID="99f45c1331b7cc8ff90a22a4caf1dc21c9a11f5a7a85486f23334f559515c3dd" exitCode=0 May 21 02:08:27.347506 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.347471 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8cwq" event={"ID":"72d3e1d4-7220-4023-bdc2-07a67cfad747","Type":"ContainerDied","Data":"99f45c1331b7cc8ff90a22a4caf1dc21c9a11f5a7a85486f23334f559515c3dd"} May 21 02:08:27.348632 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.348613 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"78cff920d8fcefd199f4ee2b9fde7dc37da0ea451c49f6c7933b6d411b82f763"} May 21 02:08:27.364007 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.363962 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xtcpr" podStartSLOduration=1.403579299 podStartE2EDuration="3.363949375s" podCreationTimestamp="2026-05-21 02:08:24 +0000 UTC" firstStartedPulling="2026-05-21 02:08:24.812452886 +0000 UTC m=+158.575685249" lastFinishedPulling="2026-05-21 02:08:26.772822948 +0000 UTC m=+160.536055325" observedRunningTime="2026-05-21 02:08:27.362449147 +0000 UTC m=+161.125681532" watchObservedRunningTime="2026-05-21 02:08:27.363949375 +0000 UTC m=+161.127181759" May 21 02:08:27.378926 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:27.378874 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-67brb" podStartSLOduration=2.153965786 podStartE2EDuration="3.378858339s" podCreationTimestamp="2026-05-21 02:08:24 +0000 UTC" firstStartedPulling="2026-05-21 02:08:25.547943427 +0000 UTC m=+159.311175790" lastFinishedPulling="2026-05-21 02:08:26.772835967 +0000 UTC m=+160.536068343" observedRunningTime="2026-05-21 02:08:27.377254334 +0000 UTC m=+161.140486720" watchObservedRunningTime="2026-05-21 02:08:27.378858339 +0000 UTC m=+161.142090725" May 21 02:08:28.060926 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.060891 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:08:28.061387 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.060937 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:08:28.063547 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.063523 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11211a5d-656f-4fc7-bad2-06a89a7a761a-metrics-tls\") pod \"dns-default-kpkrw\" (UID: \"11211a5d-656f-4fc7-bad2-06a89a7a761a\") " pod="openshift-dns/dns-default-kpkrw" May 21 02:08:28.063685 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.063604 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca558918-82a6-4677-9d2b-05304be9cf29-cert\") pod \"ingress-canary-sh86t\" (UID: \"ca558918-82a6-4677-9d2b-05304be9cf29\") " pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:08:28.122654 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.122624 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2mvhm\"" May 21 02:08:28.131507 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.131477 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpkrw" May 21 02:08:28.264134 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.264105 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpkrw"] May 21 02:08:28.266474 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:28.266444 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11211a5d_656f_4fc7_bad2_06a89a7a761a.slice/crio-e8a10dd88d58121dfeabae2eebda8e70fc80302868ae12871acc5e6a2537c6a9 WatchSource:0}: Error finding container e8a10dd88d58121dfeabae2eebda8e70fc80302868ae12871acc5e6a2537c6a9: Status 404 returned error can't find the container with id e8a10dd88d58121dfeabae2eebda8e70fc80302868ae12871acc5e6a2537c6a9 May 21 02:08:28.352593 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.352517 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpkrw" event={"ID":"11211a5d-656f-4fc7-bad2-06a89a7a761a","Type":"ContainerStarted","Data":"e8a10dd88d58121dfeabae2eebda8e70fc80302868ae12871acc5e6a2537c6a9"} May 21 02:08:28.354232 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.354207 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8cwq" event={"ID":"72d3e1d4-7220-4023-bdc2-07a67cfad747","Type":"ContainerStarted","Data":"4db389cf63815d59b7362ea4add6293ae70c8b17c6645f7b93cc7534aec0c1bf"} May 21 02:08:28.354379 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.354241 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8cwq" event={"ID":"72d3e1d4-7220-4023-bdc2-07a67cfad747","Type":"ContainerStarted","Data":"1087e03f8174c9be9533dafb95405fcb9b4991824612a11c35f9dffd886de70f"} May 21 02:08:28.386588 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:28.386536 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d8cwq" podStartSLOduration=2.921709255 podStartE2EDuration="4.386521359s" podCreationTimestamp="2026-05-21 02:08:24 +0000 UTC" firstStartedPulling="2026-05-21 02:08:25.308025 +0000 UTC m=+159.071257369" lastFinishedPulling="2026-05-21 02:08:26.772837089 +0000 UTC m=+160.536069473" observedRunningTime="2026-05-21 02:08:28.385914421 +0000 UTC m=+162.149146807" watchObservedRunningTime="2026-05-21 02:08:28.386521359 +0000 UTC m=+162.149753773" May 21 02:08:29.359151 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:29.359110 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"7a41ec04e7605a61f948158b9a3f5231959b595dbac51a6c91031f37d79f42ba"} May 21 02:08:29.359541 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:29.359157 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"fd9b1fe9e8424ab65b70920173e4633319c9345382bf9292d1230075bc52e019"} May 21 02:08:29.359541 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:29.359173 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"473f592556236e4fc5d0f596db15822945b34d68c47a239830f30810118e41dd"} May 21 02:08:31.370303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.370266 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"6767312ba2536ff66d2a3b527504ef5eaae3fc63a1dab1f493b269946ea90660"} May 21 02:08:31.370303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.370310 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"bbedeaee028419cd2d9baa51fce0dfcf79a47194ea132b4704d8569eeab0faa7"} May 21 02:08:31.370804 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.370320 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" event={"ID":"4e04fcda-7372-480e-8e40-6cb9be801659","Type":"ContainerStarted","Data":"9d21edd73f6f7353e4234f5bc4b4d0afa0f95b5521aea6ea2b343ac99cade555"} May 21 02:08:31.370804 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.370364 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:31.371809 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.371789 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpkrw" event={"ID":"11211a5d-656f-4fc7-bad2-06a89a7a761a","Type":"ContainerStarted","Data":"fe89aa2933581f56c1d274bfd7fed1ae339f2e39ab97634e53e2d9a9e373314e"} May 21 02:08:31.371856 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.371816 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpkrw" event={"ID":"11211a5d-656f-4fc7-bad2-06a89a7a761a","Type":"ContainerStarted","Data":"e2be2deae3b6c693ce780eba4e50d28f92dbd44582473aee8383ea5f9f0e9002"} May 21 02:08:31.371921 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.371907 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kpkrw" May 21 02:08:31.390802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.390730 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" podStartSLOduration=1.9157787160000002 podStartE2EDuration="5.390716704s" podCreationTimestamp="2026-05-21 02:08:26 +0000 UTC" firstStartedPulling="2026-05-21 02:08:26.918790119 +0000 UTC m=+160.682022495" lastFinishedPulling="2026-05-21 02:08:30.393728106 +0000 UTC m=+164.156960483" observedRunningTime="2026-05-21 02:08:31.389150768 +0000 UTC m=+165.152383165" watchObservedRunningTime="2026-05-21 02:08:31.390716704 +0000 UTC m=+165.153949088" May 21 02:08:31.405821 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:31.405781 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kpkrw" podStartSLOduration=129.281072209 podStartE2EDuration="2m11.405767493s" podCreationTimestamp="2026-05-21 02:06:20 +0000 UTC" firstStartedPulling="2026-05-21 02:08:28.268282216 +0000 UTC m=+162.031514582" lastFinishedPulling="2026-05-21 02:08:30.3929775 +0000 UTC m=+164.156209866" observedRunningTime="2026-05-21 02:08:31.40455525 +0000 UTC m=+165.167787629" watchObservedRunningTime="2026-05-21 02:08:31.405767493 +0000 UTC m=+165.168999878" May 21 02:08:33.205382 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.205350 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd5f996f7-9qhwd"] May 21 02:08:33.237224 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.237194 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64669bc4b6-8pzk9"] May 21 02:08:33.240336 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.240321 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.247719 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.247696 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64669bc4b6-8pzk9"] May 21 02:08:33.314140 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314106 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7csx9\" (UniqueName: \"kubernetes.io/projected/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-kube-api-access-7csx9\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.314140 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314150 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-oauth-config\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.314306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314175 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-trusted-ca-bundle\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.314306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314213 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-config\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.314306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314230 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-oauth-serving-cert\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.314408 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314302 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-serving-cert\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.314408 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.314366 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-service-ca\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414816 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414739 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-service-ca\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414850 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7csx9\" (UniqueName: \"kubernetes.io/projected/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-kube-api-access-7csx9\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414872 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-oauth-config\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414899 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-trusted-ca-bundle\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414922 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-config\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414944 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-oauth-serving-cert\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.414996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.414978 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-serving-cert\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.415665 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.415638 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-service-ca\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.415809 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.415639 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-config\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.415809 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.415657 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-oauth-serving-cert\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.415809 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.415741 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-trusted-ca-bundle\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.417329 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.417311 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-oauth-config\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.417428 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.417412 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-serving-cert\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.421817 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.421796 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7csx9\" (UniqueName: \"kubernetes.io/projected/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-kube-api-access-7csx9\") pod \"console-64669bc4b6-8pzk9\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.549450 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.549425 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:33.673967 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:33.673933 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64669bc4b6-8pzk9"] May 21 02:08:33.676780 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:33.676739 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f7572b_f60d_4f0b_ba27_b86e2ce360c1.slice/crio-e5793a9fda24e1c15736dfaf1a8960d687df3b19cf4e081803d645065a31e99d WatchSource:0}: Error finding container e5793a9fda24e1c15736dfaf1a8960d687df3b19cf4e081803d645065a31e99d: Status 404 returned error can't find the container with id e5793a9fda24e1c15736dfaf1a8960d687df3b19cf4e081803d645065a31e99d May 21 02:08:34.382560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.382525 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64669bc4b6-8pzk9" event={"ID":"64f7572b-f60d-4f0b-ba27-b86e2ce360c1","Type":"ContainerStarted","Data":"cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b"} May 21 02:08:34.382560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.382559 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64669bc4b6-8pzk9" event={"ID":"64f7572b-f60d-4f0b-ba27-b86e2ce360c1","Type":"ContainerStarted","Data":"e5793a9fda24e1c15736dfaf1a8960d687df3b19cf4e081803d645065a31e99d"} May 21 02:08:34.397409 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.397363 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64669bc4b6-8pzk9" podStartSLOduration=1.39734924 podStartE2EDuration="1.39734924s" podCreationTimestamp="2026-05-21 02:08:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:08:34.39702199 +0000 UTC m=+168.160254376" watchObservedRunningTime="2026-05-21 02:08:34.39734924 +0000 UTC m=+168.160581627" May 21 02:08:34.854026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.853995 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:08:34.854026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.853995 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:08:34.856986 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.856969 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x7bwd\"" May 21 02:08:34.864934 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.864909 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sh86t" May 21 02:08:34.986944 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:34.986914 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sh86t"] May 21 02:08:34.989892 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:08:34.989853 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca558918_82a6_4677_9d2b_05304be9cf29.slice/crio-bf01b0da86112f28a0e8c5af6e5ca4d70db5139dc155f2aabd295b5a9cdb2eed WatchSource:0}: Error finding container bf01b0da86112f28a0e8c5af6e5ca4d70db5139dc155f2aabd295b5a9cdb2eed: Status 404 returned error can't find the container with id bf01b0da86112f28a0e8c5af6e5ca4d70db5139dc155f2aabd295b5a9cdb2eed May 21 02:08:35.386371 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:35.386333 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sh86t" event={"ID":"ca558918-82a6-4677-9d2b-05304be9cf29","Type":"ContainerStarted","Data":"bf01b0da86112f28a0e8c5af6e5ca4d70db5139dc155f2aabd295b5a9cdb2eed"} May 21 02:08:35.515203 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:35.515168 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:35.515203 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:35.515209 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:08:35.516696 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:35.516670 2548 patch_prober.go:28] interesting pod/console-5d87f9d849-mj9s2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= May 21 02:08:35.516827 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:35.516714 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d87f9d849-mj9s2" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" May 21 02:08:37.382256 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:37.382229 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b67b96fb7-q2bnd" May 21 02:08:37.392556 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:37.392520 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sh86t" event={"ID":"ca558918-82a6-4677-9d2b-05304be9cf29","Type":"ContainerStarted","Data":"4900ee7ab1af09de0fda3a740b1c9068589968f0e15eae180c836d4d78dd9894"} May 21 02:08:37.416307 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:37.416262 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sh86t" podStartSLOduration=135.471678933 podStartE2EDuration="2m17.416248828s" podCreationTimestamp="2026-05-21 02:06:20 +0000 UTC" firstStartedPulling="2026-05-21 02:08:34.991846052 +0000 UTC m=+168.755078416" lastFinishedPulling="2026-05-21 02:08:36.936415945 +0000 UTC m=+170.699648311" observedRunningTime="2026-05-21 02:08:37.416091583 +0000 UTC m=+171.179323969" watchObservedRunningTime="2026-05-21 02:08:37.416248828 +0000 UTC m=+171.179481212" May 21 02:08:41.377409 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:41.377379 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kpkrw" May 21 02:08:43.550038 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:43.550008 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:43.550384 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:43.550051 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:43.551517 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:43.551493 2548 patch_prober.go:28] interesting pod/console-64669bc4b6-8pzk9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 21 02:08:43.551602 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:43.551533 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64669bc4b6-8pzk9" podUID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 21 02:08:45.515190 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:45.515155 2548 patch_prober.go:28] interesting pod/console-5d87f9d849-mj9s2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= May 21 02:08:45.515575 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:45.515204 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d87f9d849-mj9s2" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" May 21 02:08:53.438613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:53.438580 2548 generic.go:358] "Generic (PLEG): container finished" podID="05fc18aa-dbbd-4da2-88ab-4ff7aada0845" containerID="c6129f22fc078cf2055620b3a95c853536c6a465124de0c6e82c93b16962b595" exitCode=0 May 21 02:08:53.439028 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:53.438628 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" event={"ID":"05fc18aa-dbbd-4da2-88ab-4ff7aada0845","Type":"ContainerDied","Data":"c6129f22fc078cf2055620b3a95c853536c6a465124de0c6e82c93b16962b595"} May 21 02:08:53.439028 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:53.438905 2548 scope.go:117] "RemoveContainer" containerID="c6129f22fc078cf2055620b3a95c853536c6a465124de0c6e82c93b16962b595" May 21 02:08:53.554114 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:53.554088 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:53.557886 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:53.557867 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:08:53.609675 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:53.609646 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d87f9d849-mj9s2"] May 21 02:08:54.442850 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:54.442811 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mzh7r" event={"ID":"05fc18aa-dbbd-4da2-88ab-4ff7aada0845","Type":"ContainerStarted","Data":"006352b2dacb948209a92bfda409684fff7eee43f8b1d31538deac2d3ccc4fb4"} May 21 02:08:58.224359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.224250 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-cd5f996f7-9qhwd" podUID="5198bcfb-d9eb-4802-937a-d9abb70402dc" containerName="console" containerID="cri-o://fe3822c4250128d5ff4d6d4f304c251a193e3a5d3bbdd858e3c31f7fcebdc34e" gracePeriod=15 May 21 02:08:58.454905 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.454881 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cd5f996f7-9qhwd_5198bcfb-d9eb-4802-937a-d9abb70402dc/console/0.log" May 21 02:08:58.455046 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.454925 2548 generic.go:358] "Generic (PLEG): container finished" podID="5198bcfb-d9eb-4802-937a-d9abb70402dc" containerID="fe3822c4250128d5ff4d6d4f304c251a193e3a5d3bbdd858e3c31f7fcebdc34e" exitCode=2 May 21 02:08:58.455046 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.455002 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd5f996f7-9qhwd" event={"ID":"5198bcfb-d9eb-4802-937a-d9abb70402dc","Type":"ContainerDied","Data":"fe3822c4250128d5ff4d6d4f304c251a193e3a5d3bbdd858e3c31f7fcebdc34e"} May 21 02:08:58.456348 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.456327 2548 generic.go:358] "Generic (PLEG): container finished" podID="04506638-714a-4d83-8197-57a6d6e7f667" containerID="3f6b8cc086126242fb9ad039179d193de746ac2d6da6f2c58ea3cbac63773814" exitCode=0 May 21 02:08:58.456450 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.456385 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4f554" event={"ID":"04506638-714a-4d83-8197-57a6d6e7f667","Type":"ContainerDied","Data":"3f6b8cc086126242fb9ad039179d193de746ac2d6da6f2c58ea3cbac63773814"} May 21 02:08:58.456839 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.456820 2548 scope.go:117] "RemoveContainer" containerID="3f6b8cc086126242fb9ad039179d193de746ac2d6da6f2c58ea3cbac63773814" May 21 02:08:58.479184 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.479164 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cd5f996f7-9qhwd_5198bcfb-d9eb-4802-937a-d9abb70402dc/console/0.log" May 21 02:08:58.479289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.479234 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:58.535306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535279 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-oauth-config\") pod \"5198bcfb-d9eb-4802-937a-d9abb70402dc\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " May 21 02:08:58.535424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535312 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-serving-cert\") pod \"5198bcfb-d9eb-4802-937a-d9abb70402dc\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " May 21 02:08:58.535424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535339 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-service-ca\") pod \"5198bcfb-d9eb-4802-937a-d9abb70402dc\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " May 21 02:08:58.535424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535360 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hsbn\" (UniqueName: \"kubernetes.io/projected/5198bcfb-d9eb-4802-937a-d9abb70402dc-kube-api-access-7hsbn\") pod \"5198bcfb-d9eb-4802-937a-d9abb70402dc\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " May 21 02:08:58.535424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535417 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-config\") pod \"5198bcfb-d9eb-4802-937a-d9abb70402dc\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " May 21 02:08:58.535630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535473 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-oauth-serving-cert\") pod \"5198bcfb-d9eb-4802-937a-d9abb70402dc\" (UID: \"5198bcfb-d9eb-4802-937a-d9abb70402dc\") " May 21 02:08:58.535715 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.535682 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "5198bcfb-d9eb-4802-937a-d9abb70402dc" (UID: "5198bcfb-d9eb-4802-937a-d9abb70402dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:08:58.536176 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.536142 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-config" (OuterVolumeSpecName: "console-config") pod "5198bcfb-d9eb-4802-937a-d9abb70402dc" (UID: "5198bcfb-d9eb-4802-937a-d9abb70402dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:08:58.536375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.536339 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5198bcfb-d9eb-4802-937a-d9abb70402dc" (UID: "5198bcfb-d9eb-4802-937a-d9abb70402dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:08:58.537606 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.537584 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5198bcfb-d9eb-4802-937a-d9abb70402dc" (UID: "5198bcfb-d9eb-4802-937a-d9abb70402dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:08:58.537679 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.537632 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5198bcfb-d9eb-4802-937a-d9abb70402dc" (UID: "5198bcfb-d9eb-4802-937a-d9abb70402dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:08:58.538095 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.538077 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5198bcfb-d9eb-4802-937a-d9abb70402dc-kube-api-access-7hsbn" (OuterVolumeSpecName: "kube-api-access-7hsbn") pod "5198bcfb-d9eb-4802-937a-d9abb70402dc" (UID: "5198bcfb-d9eb-4802-937a-d9abb70402dc"). InnerVolumeSpecName "kube-api-access-7hsbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:08:58.636537 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.636499 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:58.636537 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.636532 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:58.636537 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.636543 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:58.636775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.636553 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5198bcfb-d9eb-4802-937a-d9abb70402dc-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:58.636775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.636562 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5198bcfb-d9eb-4802-937a-d9abb70402dc-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:58.636775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:58.636571 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hsbn\" (UniqueName: \"kubernetes.io/projected/5198bcfb-d9eb-4802-937a-d9abb70402dc-kube-api-access-7hsbn\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:08:59.460798 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.460762 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4f554" event={"ID":"04506638-714a-4d83-8197-57a6d6e7f667","Type":"ContainerStarted","Data":"fabe5e69efa9b9eafe605ea8011f35c5b79398b92335cccfd23885965f82de0f"} May 21 02:08:59.461888 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.461873 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cd5f996f7-9qhwd_5198bcfb-d9eb-4802-937a-d9abb70402dc/console/0.log" May 21 02:08:59.461942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.461925 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd5f996f7-9qhwd" event={"ID":"5198bcfb-d9eb-4802-937a-d9abb70402dc","Type":"ContainerDied","Data":"46b7bccfdf7f1baccd0e4683b340b2afdc95db445fa0a6bbc86415f865972bd8"} May 21 02:08:59.461988 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.461949 2548 scope.go:117] "RemoveContainer" containerID="fe3822c4250128d5ff4d6d4f304c251a193e3a5d3bbdd858e3c31f7fcebdc34e" May 21 02:08:59.461988 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.461956 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd5f996f7-9qhwd" May 21 02:08:59.490230 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.490199 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd5f996f7-9qhwd"] May 21 02:08:59.495618 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:08:59.495593 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd5f996f7-9qhwd"] May 21 02:09:00.855281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:00.855244 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5198bcfb-d9eb-4802-937a-d9abb70402dc" path="/var/lib/kubelet/pods/5198bcfb-d9eb-4802-937a-d9abb70402dc/volumes" May 21 02:09:02.851103 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:02.851075 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xtcpr_bb8aa146-d4b8-48e4-a555-117ea71340c6/kube-state-metrics/0.log" May 21 02:09:03.050575 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:03.050544 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xtcpr_bb8aa146-d4b8-48e4-a555-117ea71340c6/kube-rbac-proxy-main/0.log" May 21 02:09:03.251068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:03.251041 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xtcpr_bb8aa146-d4b8-48e4-a555-117ea71340c6/kube-rbac-proxy-self/0.log" May 21 02:09:03.852139 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:03.852112 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8cwq_72d3e1d4-7220-4023-bdc2-07a67cfad747/init-textfile/0.log" May 21 02:09:04.051098 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:04.051069 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8cwq_72d3e1d4-7220-4023-bdc2-07a67cfad747/node-exporter/0.log" May 21 02:09:04.250566 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:04.250542 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8cwq_72d3e1d4-7220-4023-bdc2-07a67cfad747/kube-rbac-proxy/0.log" May 21 02:09:05.650446 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:05.650419 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-67brb_c464c525-a51d-48b5-8ef4-4304ed6f1902/kube-rbac-proxy-main/0.log" May 21 02:09:05.850480 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:05.850443 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-67brb_c464c525-a51d-48b5-8ef4-4304ed6f1902/kube-rbac-proxy-self/0.log" May 21 02:09:06.050135 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:06.050106 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-67brb_c464c525-a51d-48b5-8ef4-4304ed6f1902/openshift-state-metrics/0.log" May 21 02:09:07.652987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:07.652951 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gqbv5_7e219106-e1f5-4569-b3b8-0f40c9df9f84/prometheus-operator/0.log" May 21 02:09:07.853448 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:07.853418 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gqbv5_7e219106-e1f5-4569-b3b8-0f40c9df9f84/kube-rbac-proxy/0.log" May 21 02:09:08.050068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:08.050044 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-x9f49_9e94c5b0-62df-4a74-a81e-54a0a2714c96/prometheus-operator-admission-webhook/0.log" May 21 02:09:08.250162 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:08.250128 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/thanos-query/0.log" May 21 02:09:08.450299 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:08.450225 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy-web/0.log" May 21 02:09:08.650518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:08.650489 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy/0.log" May 21 02:09:08.851002 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:08.850976 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/prom-label-proxy/0.log" May 21 02:09:09.050206 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:09.050182 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy-rules/0.log" May 21 02:09:09.251159 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:09.251131 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy-metrics/0.log" May 21 02:09:10.051284 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:10.051261 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d87f9d849-mj9s2_491fd9ad-24a3-46c0-9522-4ac9af41ebac/console/0.log" May 21 02:09:10.250996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:10.250967 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64669bc4b6-8pzk9_64f7572b-f60d-4f0b-ba27-b86e2ce360c1/console/0.log" May 21 02:09:11.250361 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:11.250336 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpkrw_11211a5d-656f-4fc7-bad2-06a89a7a761a/dns/0.log" May 21 02:09:11.450469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:11.450441 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpkrw_11211a5d-656f-4fc7-bad2-06a89a7a761a/kube-rbac-proxy/0.log" May 21 02:09:12.450516 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:12.450483 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhnnz_9c226802-7713-4756-8df1-ad0e72419838/dns-node-resolver/0.log" May 21 02:09:13.450680 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:13.450648 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7dcj_27df3f90-1575-48ea-93c0-0ea337913b1b/node-ca/0.log" May 21 02:09:14.250989 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:14.250958 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sh86t_ca558918-82a6-4677-9d2b-05304be9cf29/serve-healthcheck-canary/0.log" May 21 02:09:18.631718 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:18.631676 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5d87f9d849-mj9s2" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerName="console" containerID="cri-o://bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006" gracePeriod=15 May 21 02:09:18.874574 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:18.874551 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d87f9d849-mj9s2_491fd9ad-24a3-46c0-9522-4ac9af41ebac/console/0.log" May 21 02:09:18.874687 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:18.874614 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:09:19.024477 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024442 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj776\" (UniqueName: \"kubernetes.io/projected/491fd9ad-24a3-46c0-9522-4ac9af41ebac-kube-api-access-xj776\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.024652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024486 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-oauth-config\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.024652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024504 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-serving-cert\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.024652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024527 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-oauth-serving-cert\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.024652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024552 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-service-ca\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.024652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024606 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-config\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.024652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.024630 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-trusted-ca-bundle\") pod \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\" (UID: \"491fd9ad-24a3-46c0-9522-4ac9af41ebac\") " May 21 02:09:19.025191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.025139 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:09:19.025191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.025167 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-service-ca" (OuterVolumeSpecName: "service-ca") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:09:19.025191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.025179 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-config" (OuterVolumeSpecName: "console-config") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:09:19.025367 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.025345 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:09:19.026738 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.026711 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491fd9ad-24a3-46c0-9522-4ac9af41ebac-kube-api-access-xj776" (OuterVolumeSpecName: "kube-api-access-xj776") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "kube-api-access-xj776". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:09:19.027108 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.027086 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:09:19.027179 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.027107 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "491fd9ad-24a3-46c0-9522-4ac9af41ebac" (UID: "491fd9ad-24a3-46c0-9522-4ac9af41ebac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:09:19.125996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.125967 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj776\" (UniqueName: \"kubernetes.io/projected/491fd9ad-24a3-46c0-9522-4ac9af41ebac-kube-api-access-xj776\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.125996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.125992 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.125996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.126003 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.126240 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.126012 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.126240 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.126024 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.126240 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.126033 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.126240 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.126041 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491fd9ad-24a3-46c0-9522-4ac9af41ebac-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:09:19.522951 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.522925 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d87f9d849-mj9s2_491fd9ad-24a3-46c0-9522-4ac9af41ebac/console/0.log" May 21 02:09:19.523167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.522962 2548 generic.go:358] "Generic (PLEG): container finished" podID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerID="bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006" exitCode=2 May 21 02:09:19.523167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.523029 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d87f9d849-mj9s2" May 21 02:09:19.523167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.523042 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d87f9d849-mj9s2" event={"ID":"491fd9ad-24a3-46c0-9522-4ac9af41ebac","Type":"ContainerDied","Data":"bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006"} May 21 02:09:19.523167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.523075 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d87f9d849-mj9s2" event={"ID":"491fd9ad-24a3-46c0-9522-4ac9af41ebac","Type":"ContainerDied","Data":"aea52934b30080866bc8a64026f8e47f8b1968e573f555247fef47dc8f70833f"} May 21 02:09:19.523167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.523092 2548 scope.go:117] "RemoveContainer" containerID="bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006" May 21 02:09:19.531830 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.531796 2548 scope.go:117] "RemoveContainer" containerID="bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006" May 21 02:09:19.532230 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:09:19.532208 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006\": container with ID starting with bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006 not found: ID does not exist" containerID="bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006" May 21 02:09:19.532320 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.532237 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006"} err="failed to get container status \"bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006\": rpc error: code = NotFound desc = could not find container \"bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006\": container with ID starting with bd3d74ecfd27099d7d846bac8547c6e4a0e6f6db1fe220955bc537c21fc48006 not found: ID does not exist" May 21 02:09:19.543645 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.543620 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d87f9d849-mj9s2"] May 21 02:09:19.549649 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:19.549625 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d87f9d849-mj9s2"] May 21 02:09:20.854932 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:20.854901 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" path="/var/lib/kubelet/pods/491fd9ad-24a3-46c0-9522-4ac9af41ebac/volumes" May 21 02:09:53.150442 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150411 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-594f48f567-pzwsq"] May 21 02:09:53.150860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150714 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerName="console" May 21 02:09:53.150860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150726 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerName="console" May 21 02:09:53.150860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150757 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5198bcfb-d9eb-4802-937a-d9abb70402dc" containerName="console" May 21 02:09:53.150860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150765 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5198bcfb-d9eb-4802-937a-d9abb70402dc" containerName="console" May 21 02:09:53.150860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150831 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="491fd9ad-24a3-46c0-9522-4ac9af41ebac" containerName="console" May 21 02:09:53.150860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.150845 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="5198bcfb-d9eb-4802-937a-d9abb70402dc" containerName="console" May 21 02:09:53.155096 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.155079 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.161239 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.161216 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594f48f567-pzwsq"] May 21 02:09:53.197887 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.197854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-serving-cert\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.198066 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.197917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-oauth-config\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.198066 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.197939 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-console-config\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.198066 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.197984 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-trusted-ca-bundle\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.198066 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.198042 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mkbz\" (UniqueName: \"kubernetes.io/projected/f1843b05-504c-4340-ac92-f24740d2ef63-kube-api-access-9mkbz\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.198270 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.198079 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-service-ca\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.198270 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.198096 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-oauth-serving-cert\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299387 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-oauth-config\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299425 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-console-config\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299652 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299469 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-trusted-ca-bundle\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299714 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299656 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mkbz\" (UniqueName: \"kubernetes.io/projected/f1843b05-504c-4340-ac92-f24740d2ef63-kube-api-access-9mkbz\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299801 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299711 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-service-ca\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299801 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299739 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-oauth-serving-cert\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.299904 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.299840 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-serving-cert\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.300365 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.300326 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-service-ca\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.300365 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.300350 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-console-config\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.300508 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.300419 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-trusted-ca-bundle\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.300508 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.300480 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-oauth-serving-cert\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.301995 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.301974 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-oauth-config\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.302123 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.302107 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-serving-cert\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.306857 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.306833 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mkbz\" (UniqueName: \"kubernetes.io/projected/f1843b05-504c-4340-ac92-f24740d2ef63-kube-api-access-9mkbz\") pod \"console-594f48f567-pzwsq\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.464991 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.464891 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:09:53.589496 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.589446 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594f48f567-pzwsq"] May 21 02:09:53.591761 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:09:53.591701 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1843b05_504c_4340_ac92_f24740d2ef63.slice/crio-f7f1acbfaaaf4abc285a83b9d95060b4cf153965e1d62b6f9d18101c20b22385 WatchSource:0}: Error finding container f7f1acbfaaaf4abc285a83b9d95060b4cf153965e1d62b6f9d18101c20b22385: Status 404 returned error can't find the container with id f7f1acbfaaaf4abc285a83b9d95060b4cf153965e1d62b6f9d18101c20b22385 May 21 02:09:53.618893 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:53.618867 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f48f567-pzwsq" event={"ID":"f1843b05-504c-4340-ac92-f24740d2ef63","Type":"ContainerStarted","Data":"f7f1acbfaaaf4abc285a83b9d95060b4cf153965e1d62b6f9d18101c20b22385"} May 21 02:09:54.623162 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:54.623127 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f48f567-pzwsq" event={"ID":"f1843b05-504c-4340-ac92-f24740d2ef63","Type":"ContainerStarted","Data":"6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594"} May 21 02:09:54.638457 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:54.638412 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-594f48f567-pzwsq" podStartSLOduration=1.638398536 podStartE2EDuration="1.638398536s" podCreationTimestamp="2026-05-21 02:09:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:09:54.638306524 +0000 UTC m=+248.401538908" watchObservedRunningTime="2026-05-21 02:09:54.638398536 +0000 UTC m=+248.401630920" May 21 02:09:58.643443 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:58.643413 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:09:58.645741 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:58.645718 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dc202d3-7440-4df8-96f2-09c3248bcacb-metrics-certs\") pod \"network-metrics-daemon-j4nwr\" (UID: \"8dc202d3-7440-4df8-96f2-09c3248bcacb\") " pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:09:58.857655 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:58.857628 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs9f7\"" May 21 02:09:58.865689 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:58.865670 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4nwr" May 21 02:09:58.986655 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:58.986630 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j4nwr"] May 21 02:09:58.989167 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:09:58.989121 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc202d3_7440_4df8_96f2_09c3248bcacb.slice/crio-eb0d8e317a3088c2d2513f1c503e204da7c32c9c85b7b63b1ff887f3edd7b0f1 WatchSource:0}: Error finding container eb0d8e317a3088c2d2513f1c503e204da7c32c9c85b7b63b1ff887f3edd7b0f1: Status 404 returned error can't find the container with id eb0d8e317a3088c2d2513f1c503e204da7c32c9c85b7b63b1ff887f3edd7b0f1 May 21 02:09:59.638075 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:09:59.638037 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4nwr" event={"ID":"8dc202d3-7440-4df8-96f2-09c3248bcacb","Type":"ContainerStarted","Data":"eb0d8e317a3088c2d2513f1c503e204da7c32c9c85b7b63b1ff887f3edd7b0f1"} May 21 02:10:00.643424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:00.643384 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4nwr" event={"ID":"8dc202d3-7440-4df8-96f2-09c3248bcacb","Type":"ContainerStarted","Data":"c1c384ab26c7ccee0dbeabed9cdd594b5ce1780f62a03c0143c33b28362dc8cd"} May 21 02:10:00.643424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:00.643426 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4nwr" event={"ID":"8dc202d3-7440-4df8-96f2-09c3248bcacb","Type":"ContainerStarted","Data":"566cf659de47ca4c356f605bbe8492c97d212d00d894406eed9596ffd1eb78be"} May 21 02:10:00.664441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:00.662155 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j4nwr" podStartSLOduration=252.690625625 podStartE2EDuration="4m13.662136252s" podCreationTimestamp="2026-05-21 02:05:47 +0000 UTC" firstStartedPulling="2026-05-21 02:09:58.990918886 +0000 UTC m=+252.754151252" lastFinishedPulling="2026-05-21 02:09:59.962429513 +0000 UTC m=+253.725661879" observedRunningTime="2026-05-21 02:10:00.659251957 +0000 UTC m=+254.422484341" watchObservedRunningTime="2026-05-21 02:10:00.662136252 +0000 UTC m=+254.425368638" May 21 02:10:03.466019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.465981 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:10:03.466019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.466022 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:10:03.470701 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.470677 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:10:03.655774 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.655729 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:10:03.700104 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.700072 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64669bc4b6-8pzk9"] May 21 02:10:03.763647 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.763615 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c449f4b96-2ck5q"] May 21 02:10:03.766897 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.766880 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.776846 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.776820 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c449f4b96-2ck5q"] May 21 02:10:03.889459 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889426 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvqvh\" (UniqueName: \"kubernetes.io/projected/38d446c2-6848-43eb-a9eb-06153628a00b-kube-api-access-wvqvh\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.889627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889471 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-console-config\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.889627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889504 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-oauth-serving-cert\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.889627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889558 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-oauth-config\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.889627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889577 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-service-ca\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.889627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889608 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-serving-cert\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.889811 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.889634 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-trusted-ca-bundle\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990029 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.989977 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-oauth-serving-cert\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990029 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990037 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-oauth-config\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990269 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990056 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-service-ca\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990269 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990083 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-serving-cert\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990269 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990107 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-trusted-ca-bundle\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990269 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990133 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvqvh\" (UniqueName: \"kubernetes.io/projected/38d446c2-6848-43eb-a9eb-06153628a00b-kube-api-access-wvqvh\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990269 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990167 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-console-config\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990784 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990735 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-oauth-serving-cert\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990784 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990775 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-service-ca\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.990979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.990958 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-console-config\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.991090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.991069 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-trusted-ca-bundle\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.992643 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.992621 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-oauth-config\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.993005 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.992987 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-serving-cert\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:03.997899 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:03.997880 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvqvh\" (UniqueName: \"kubernetes.io/projected/38d446c2-6848-43eb-a9eb-06153628a00b-kube-api-access-wvqvh\") pod \"console-5c449f4b96-2ck5q\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:04.076505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:04.076422 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:04.205326 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:04.205300 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c449f4b96-2ck5q"] May 21 02:10:04.207622 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:10:04.207595 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d446c2_6848_43eb_a9eb_06153628a00b.slice/crio-14f6f6067348e95dccc1913d07a55ced32a9f1d89a8e1a25be413e7f3f2907a8 WatchSource:0}: Error finding container 14f6f6067348e95dccc1913d07a55ced32a9f1d89a8e1a25be413e7f3f2907a8: Status 404 returned error can't find the container with id 14f6f6067348e95dccc1913d07a55ced32a9f1d89a8e1a25be413e7f3f2907a8 May 21 02:10:04.655518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:04.655479 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c449f4b96-2ck5q" event={"ID":"38d446c2-6848-43eb-a9eb-06153628a00b","Type":"ContainerStarted","Data":"1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad"} May 21 02:10:04.655518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:04.655521 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c449f4b96-2ck5q" event={"ID":"38d446c2-6848-43eb-a9eb-06153628a00b","Type":"ContainerStarted","Data":"14f6f6067348e95dccc1913d07a55ced32a9f1d89a8e1a25be413e7f3f2907a8"} May 21 02:10:04.674143 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:04.674097 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c449f4b96-2ck5q" podStartSLOduration=1.674083133 podStartE2EDuration="1.674083133s" podCreationTimestamp="2026-05-21 02:10:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:10:04.672272404 +0000 UTC m=+258.435504790" watchObservedRunningTime="2026-05-21 02:10:04.674083133 +0000 UTC m=+258.437315518" May 21 02:10:14.077059 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:14.076964 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:14.077059 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:14.077019 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:14.081622 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:14.081598 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:14.688035 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:14.688003 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:10:14.732002 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:14.731968 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594f48f567-pzwsq"] May 21 02:10:28.720058 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:28.720000 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64669bc4b6-8pzk9" podUID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" containerName="console" containerID="cri-o://cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b" gracePeriod=15 May 21 02:10:28.960806 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:28.960784 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64669bc4b6-8pzk9_64f7572b-f60d-4f0b-ba27-b86e2ce360c1/console/0.log" May 21 02:10:28.960928 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:28.960843 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:10:29.112473 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112433 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-service-ca\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.112473 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112480 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-oauth-serving-cert\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.112739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112513 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-config\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.112739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112576 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-serving-cert\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.112739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112604 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-oauth-config\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.112739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112647 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7csx9\" (UniqueName: \"kubernetes.io/projected/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-kube-api-access-7csx9\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.112739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112676 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-trusted-ca-bundle\") pod \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\" (UID: \"64f7572b-f60d-4f0b-ba27-b86e2ce360c1\") " May 21 02:10:29.113025 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112946 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:29.113025 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.112999 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:29.113141 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.113016 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-config" (OuterVolumeSpecName: "console-config") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:29.113269 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.113249 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:29.115016 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.114990 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-kube-api-access-7csx9" (OuterVolumeSpecName: "kube-api-access-7csx9") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "kube-api-access-7csx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:10:29.115016 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.114992 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:10:29.115191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.115157 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "64f7572b-f60d-4f0b-ba27-b86e2ce360c1" (UID: "64f7572b-f60d-4f0b-ba27-b86e2ce360c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:10:29.213613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213569 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.213613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213603 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.213613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213613 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7csx9\" (UniqueName: \"kubernetes.io/projected/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-kube-api-access-7csx9\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.213613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213623 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.213920 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213634 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.213920 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213642 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.213920 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.213651 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64f7572b-f60d-4f0b-ba27-b86e2ce360c1-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:29.730184 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.730157 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64669bc4b6-8pzk9_64f7572b-f60d-4f0b-ba27-b86e2ce360c1/console/0.log" May 21 02:10:29.730601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.730200 2548 generic.go:358] "Generic (PLEG): container finished" podID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" containerID="cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b" exitCode=2 May 21 02:10:29.730601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.730269 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64669bc4b6-8pzk9" May 21 02:10:29.730601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.730266 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64669bc4b6-8pzk9" event={"ID":"64f7572b-f60d-4f0b-ba27-b86e2ce360c1","Type":"ContainerDied","Data":"cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b"} May 21 02:10:29.730601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.730382 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64669bc4b6-8pzk9" event={"ID":"64f7572b-f60d-4f0b-ba27-b86e2ce360c1","Type":"ContainerDied","Data":"e5793a9fda24e1c15736dfaf1a8960d687df3b19cf4e081803d645065a31e99d"} May 21 02:10:29.730601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.730404 2548 scope.go:117] "RemoveContainer" containerID="cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b" May 21 02:10:29.739464 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.739441 2548 scope.go:117] "RemoveContainer" containerID="cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b" May 21 02:10:29.739763 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:10:29.739724 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b\": container with ID starting with cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b not found: ID does not exist" containerID="cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b" May 21 02:10:29.739829 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.739769 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b"} err="failed to get container status \"cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b\": rpc error: code = NotFound desc = could not find container \"cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b\": container with ID starting with cc1b46048a552b6fe8c1f9c2fff92413bb664b134342a4359c87fc93cadc8f5b not found: ID does not exist" May 21 02:10:29.750948 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.750923 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64669bc4b6-8pzk9"] May 21 02:10:29.753880 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:29.753858 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64669bc4b6-8pzk9"] May 21 02:10:30.855173 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:30.855140 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" path="/var/lib/kubelet/pods/64f7572b-f60d-4f0b-ba27-b86e2ce360c1/volumes" May 21 02:10:39.751520 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:39.751450 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-594f48f567-pzwsq" podUID="f1843b05-504c-4340-ac92-f24740d2ef63" containerName="console" containerID="cri-o://6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594" gracePeriod=15 May 21 02:10:39.990726 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:39.990705 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-594f48f567-pzwsq_f1843b05-504c-4340-ac92-f24740d2ef63/console/0.log" May 21 02:10:39.990858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:39.990786 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:10:40.002171 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002120 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mkbz\" (UniqueName: \"kubernetes.io/projected/f1843b05-504c-4340-ac92-f24740d2ef63-kube-api-access-9mkbz\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002171 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002167 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-serving-cert\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002192 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-oauth-config\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002226 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-oauth-serving-cert\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002267 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-trusted-ca-bundle\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002394 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002297 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-service-ca\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002394 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002364 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-console-config\") pod \"f1843b05-504c-4340-ac92-f24740d2ef63\" (UID: \"f1843b05-504c-4340-ac92-f24740d2ef63\") " May 21 02:10:40.002829 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002704 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:40.002933 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002712 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:40.002933 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002716 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:40.002933 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.002915 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-console-config" (OuterVolumeSpecName: "console-config") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:10:40.004283 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.004263 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1843b05-504c-4340-ac92-f24740d2ef63-kube-api-access-9mkbz" (OuterVolumeSpecName: "kube-api-access-9mkbz") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "kube-api-access-9mkbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:10:40.004717 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.004700 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:10:40.004808 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.004721 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1843b05-504c-4340-ac92-f24740d2ef63" (UID: "f1843b05-504c-4340-ac92-f24740d2ef63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:10:40.103138 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103101 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.103138 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103132 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.103138 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103142 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.103370 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103151 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mkbz\" (UniqueName: \"kubernetes.io/projected/f1843b05-504c-4340-ac92-f24740d2ef63-kube-api-access-9mkbz\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.103370 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103162 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.103370 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103171 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1843b05-504c-4340-ac92-f24740d2ef63-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.103370 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.103180 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1843b05-504c-4340-ac92-f24740d2ef63-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:10:40.764757 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.764724 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-594f48f567-pzwsq_f1843b05-504c-4340-ac92-f24740d2ef63/console/0.log" May 21 02:10:40.765161 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.764782 2548 generic.go:358] "Generic (PLEG): container finished" podID="f1843b05-504c-4340-ac92-f24740d2ef63" containerID="6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594" exitCode=2 May 21 02:10:40.765161 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.764849 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f48f567-pzwsq" May 21 02:10:40.765161 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.764864 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f48f567-pzwsq" event={"ID":"f1843b05-504c-4340-ac92-f24740d2ef63","Type":"ContainerDied","Data":"6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594"} May 21 02:10:40.765161 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.764899 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f48f567-pzwsq" event={"ID":"f1843b05-504c-4340-ac92-f24740d2ef63","Type":"ContainerDied","Data":"f7f1acbfaaaf4abc285a83b9d95060b4cf153965e1d62b6f9d18101c20b22385"} May 21 02:10:40.765161 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.764917 2548 scope.go:117] "RemoveContainer" containerID="6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594" May 21 02:10:40.772913 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.772893 2548 scope.go:117] "RemoveContainer" containerID="6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594" May 21 02:10:40.773165 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:10:40.773133 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594\": container with ID starting with 6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594 not found: ID does not exist" containerID="6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594" May 21 02:10:40.773227 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.773188 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594"} err="failed to get container status \"6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594\": rpc error: code = NotFound desc = could not find container \"6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594\": container with ID starting with 6153666edac7300d4902542857eb2986b00d1f83e052b334bb277093c347e594 not found: ID does not exist" May 21 02:10:40.785905 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.785874 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594f48f567-pzwsq"] May 21 02:10:40.788597 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.788575 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594f48f567-pzwsq"] May 21 02:10:40.854559 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:40.854533 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1843b05-504c-4340-ac92-f24740d2ef63" path="/var/lib/kubelet/pods/f1843b05-504c-4340-ac92-f24740d2ef63/volumes" May 21 02:10:46.747464 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:10:46.747439 2548 kubelet.go:1628] "Image garbage collection succeeded" May 21 02:11:07.977105 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977071 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h"] May 21 02:11:07.979469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977388 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1843b05-504c-4340-ac92-f24740d2ef63" containerName="console" May 21 02:11:07.979469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977399 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1843b05-504c-4340-ac92-f24740d2ef63" containerName="console" May 21 02:11:07.979469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977408 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" containerName="console" May 21 02:11:07.979469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977414 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" containerName="console" May 21 02:11:07.979469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977483 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="64f7572b-f60d-4f0b-ba27-b86e2ce360c1" containerName="console" May 21 02:11:07.979469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.977493 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1843b05-504c-4340-ac92-f24740d2ef63" containerName="console" May 21 02:11:07.980374 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.980360 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:07.982977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.982955 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 02:11:07.982977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.982974 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 02:11:07.983163 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.982994 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z54tb\"" May 21 02:11:07.986327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:07.986306 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h"] May 21 02:11:08.017320 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.017286 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.017479 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.017346 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.017479 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.017406 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkcz\" (UniqueName: \"kubernetes.io/projected/96a16799-f590-42f3-bcb5-952ec841fd19-kube-api-access-jvkcz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.118345 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.118305 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.118512 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.118373 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.118512 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.118414 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkcz\" (UniqueName: \"kubernetes.io/projected/96a16799-f590-42f3-bcb5-952ec841fd19-kube-api-access-jvkcz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.118794 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.118774 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.118842 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.118804 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.126470 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.126431 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkcz\" (UniqueName: \"kubernetes.io/projected/96a16799-f590-42f3-bcb5-952ec841fd19-kube-api-access-jvkcz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.290739 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.290662 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:08.412951 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.412922 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h"] May 21 02:11:08.415392 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:08.415365 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a16799_f590_42f3_bcb5_952ec841fd19.slice/crio-182bfbf34556b3d26105fb3a5698c0a820f8ca7c150cc370c9eecc538a861fa8 WatchSource:0}: Error finding container 182bfbf34556b3d26105fb3a5698c0a820f8ca7c150cc370c9eecc538a861fa8: Status 404 returned error can't find the container with id 182bfbf34556b3d26105fb3a5698c0a820f8ca7c150cc370c9eecc538a861fa8 May 21 02:11:08.417152 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.417136 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:11:08.844274 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:08.844237 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" event={"ID":"96a16799-f590-42f3-bcb5-952ec841fd19","Type":"ContainerStarted","Data":"182bfbf34556b3d26105fb3a5698c0a820f8ca7c150cc370c9eecc538a861fa8"} May 21 02:11:14.867764 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:14.867707 2548 generic.go:358] "Generic (PLEG): container finished" podID="96a16799-f590-42f3-bcb5-952ec841fd19" containerID="0ecd4a9a6b96990e39f6153b94103f38a1ff4b8300901909877ce09937fe2b83" exitCode=0 May 21 02:11:14.868143 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:14.867771 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" event={"ID":"96a16799-f590-42f3-bcb5-952ec841fd19","Type":"ContainerDied","Data":"0ecd4a9a6b96990e39f6153b94103f38a1ff4b8300901909877ce09937fe2b83"} May 21 02:11:16.875491 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:16.875404 2548 generic.go:358] "Generic (PLEG): container finished" podID="96a16799-f590-42f3-bcb5-952ec841fd19" containerID="e31839d7977ef7f0ecb375865f5147eb2ec8133d4a4223b9f3e2d1259bec196d" exitCode=0 May 21 02:11:16.875491 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:16.875473 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" event={"ID":"96a16799-f590-42f3-bcb5-952ec841fd19","Type":"ContainerDied","Data":"e31839d7977ef7f0ecb375865f5147eb2ec8133d4a4223b9f3e2d1259bec196d"} May 21 02:11:24.902380 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:24.902343 2548 generic.go:358] "Generic (PLEG): container finished" podID="96a16799-f590-42f3-bcb5-952ec841fd19" containerID="c08ccf885dc186c08ce2922baa2b1b1574fb3d9143868899ffb68673f09fd67e" exitCode=0 May 21 02:11:24.902782 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:24.902433 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" event={"ID":"96a16799-f590-42f3-bcb5-952ec841fd19","Type":"ContainerDied","Data":"c08ccf885dc186c08ce2922baa2b1b1574fb3d9143868899ffb68673f09fd67e"} May 21 02:11:26.032619 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.032596 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:26.184413 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.184320 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-util\") pod \"96a16799-f590-42f3-bcb5-952ec841fd19\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " May 21 02:11:26.184413 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.184361 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-bundle\") pod \"96a16799-f590-42f3-bcb5-952ec841fd19\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " May 21 02:11:26.184413 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.184396 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvkcz\" (UniqueName: \"kubernetes.io/projected/96a16799-f590-42f3-bcb5-952ec841fd19-kube-api-access-jvkcz\") pod \"96a16799-f590-42f3-bcb5-952ec841fd19\" (UID: \"96a16799-f590-42f3-bcb5-952ec841fd19\") " May 21 02:11:26.184974 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.184950 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-bundle" (OuterVolumeSpecName: "bundle") pod "96a16799-f590-42f3-bcb5-952ec841fd19" (UID: "96a16799-f590-42f3-bcb5-952ec841fd19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:11:26.186617 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.186593 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a16799-f590-42f3-bcb5-952ec841fd19-kube-api-access-jvkcz" (OuterVolumeSpecName: "kube-api-access-jvkcz") pod "96a16799-f590-42f3-bcb5-952ec841fd19" (UID: "96a16799-f590-42f3-bcb5-952ec841fd19"). InnerVolumeSpecName "kube-api-access-jvkcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:11:26.189060 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.189035 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-util" (OuterVolumeSpecName: "util") pod "96a16799-f590-42f3-bcb5-952ec841fd19" (UID: "96a16799-f590-42f3-bcb5-952ec841fd19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:11:26.284985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.284946 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvkcz\" (UniqueName: \"kubernetes.io/projected/96a16799-f590-42f3-bcb5-952ec841fd19-kube-api-access-jvkcz\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:11:26.284985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.284978 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:11:26.284985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.284988 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96a16799-f590-42f3-bcb5-952ec841fd19-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:11:26.909877 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.909836 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" event={"ID":"96a16799-f590-42f3-bcb5-952ec841fd19","Type":"ContainerDied","Data":"182bfbf34556b3d26105fb3a5698c0a820f8ca7c150cc370c9eecc538a861fa8"} May 21 02:11:26.909877 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.909867 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhp86h" May 21 02:11:26.909877 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:26.909879 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="182bfbf34556b3d26105fb3a5698c0a820f8ca7c150cc370c9eecc538a861fa8" May 21 02:11:30.850131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850088 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46"] May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850525 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="util" May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850543 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="util" May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850562 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="extract" May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850570 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="extract" May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850592 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="pull" May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850600 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="pull" May 21 02:11:30.850707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.850685 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="96a16799-f590-42f3-bcb5-952ec841fd19" containerName="extract" May 21 02:11:30.854675 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.854650 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:30.857344 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.857316 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 02:11:30.857473 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.857400 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9vbcc\"" May 21 02:11:30.857473 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.857425 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 02:11:30.861347 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:30.861324 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46"] May 21 02:11:31.024598 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.024562 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/656dd969-1b52-4db4-b7ee-20a74137e93c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zdr46\" (UID: \"656dd969-1b52-4db4-b7ee-20a74137e93c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.024824 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.024619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b65df\" (UniqueName: \"kubernetes.io/projected/656dd969-1b52-4db4-b7ee-20a74137e93c-kube-api-access-b65df\") pod \"cert-manager-operator-controller-manager-54b9655956-zdr46\" (UID: \"656dd969-1b52-4db4-b7ee-20a74137e93c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.125529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.125436 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/656dd969-1b52-4db4-b7ee-20a74137e93c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zdr46\" (UID: \"656dd969-1b52-4db4-b7ee-20a74137e93c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.125529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.125490 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b65df\" (UniqueName: \"kubernetes.io/projected/656dd969-1b52-4db4-b7ee-20a74137e93c-kube-api-access-b65df\") pod \"cert-manager-operator-controller-manager-54b9655956-zdr46\" (UID: \"656dd969-1b52-4db4-b7ee-20a74137e93c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.125852 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.125833 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/656dd969-1b52-4db4-b7ee-20a74137e93c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zdr46\" (UID: \"656dd969-1b52-4db4-b7ee-20a74137e93c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.133124 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.133102 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b65df\" (UniqueName: \"kubernetes.io/projected/656dd969-1b52-4db4-b7ee-20a74137e93c-kube-api-access-b65df\") pod \"cert-manager-operator-controller-manager-54b9655956-zdr46\" (UID: \"656dd969-1b52-4db4-b7ee-20a74137e93c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.165278 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.165237 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" May 21 02:11:31.300663 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.300624 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46"] May 21 02:11:31.304450 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:31.304421 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656dd969_1b52_4db4_b7ee_20a74137e93c.slice/crio-5f364cb5cedd32613d65e697ee70bb2788fdd982f6fd50d79b54c481eb5484f0 WatchSource:0}: Error finding container 5f364cb5cedd32613d65e697ee70bb2788fdd982f6fd50d79b54c481eb5484f0: Status 404 returned error can't find the container with id 5f364cb5cedd32613d65e697ee70bb2788fdd982f6fd50d79b54c481eb5484f0 May 21 02:11:31.926705 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:31.926673 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" event={"ID":"656dd969-1b52-4db4-b7ee-20a74137e93c","Type":"ContainerStarted","Data":"5f364cb5cedd32613d65e697ee70bb2788fdd982f6fd50d79b54c481eb5484f0"} May 21 02:11:33.935087 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:33.935044 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" event={"ID":"656dd969-1b52-4db4-b7ee-20a74137e93c","Type":"ContainerStarted","Data":"c75ed1e7e1a8ddb81373d07bfb1a69e5941e181ee9c6a58c2020baf898ce3919"} May 21 02:11:33.958709 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:33.958638 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zdr46" podStartSLOduration=2.065901108 podStartE2EDuration="3.958618314s" podCreationTimestamp="2026-05-21 02:11:30 +0000 UTC" firstStartedPulling="2026-05-21 02:11:31.307854021 +0000 UTC m=+345.071086386" lastFinishedPulling="2026-05-21 02:11:33.200571229 +0000 UTC m=+346.963803592" observedRunningTime="2026-05-21 02:11:33.95588009 +0000 UTC m=+347.719112506" watchObservedRunningTime="2026-05-21 02:11:33.958618314 +0000 UTC m=+347.721850700" May 21 02:11:35.173867 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.173834 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk"] May 21 02:11:35.176264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.176248 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.178510 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.178490 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 02:11:35.178599 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.178496 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z54tb\"" May 21 02:11:35.179228 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.179214 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 02:11:35.188674 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.188649 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk"] May 21 02:11:35.364847 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.364811 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.365028 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.364915 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.365028 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.364973 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb7f5\" (UniqueName: \"kubernetes.io/projected/57caa66b-daca-4d51-832c-3cc886e13c0e-kube-api-access-mb7f5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.465608 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.465530 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.465758 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.465607 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.465758 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.465647 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mb7f5\" (UniqueName: \"kubernetes.io/projected/57caa66b-daca-4d51-832c-3cc886e13c0e-kube-api-access-mb7f5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.465944 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.465925 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.466007 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.465987 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.473483 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.473460 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb7f5\" (UniqueName: \"kubernetes.io/projected/57caa66b-daca-4d51-832c-3cc886e13c0e-kube-api-access-mb7f5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.485299 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.485275 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:35.612823 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.612796 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk"] May 21 02:11:35.615047 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:35.615020 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57caa66b_daca_4d51_832c_3cc886e13c0e.slice/crio-e21151cc467223f1851acab3f168455ed7c28b0b3f030c369d9df7a1eb29ac8c WatchSource:0}: Error finding container e21151cc467223f1851acab3f168455ed7c28b0b3f030c369d9df7a1eb29ac8c: Status 404 returned error can't find the container with id e21151cc467223f1851acab3f168455ed7c28b0b3f030c369d9df7a1eb29ac8c May 21 02:11:35.941715 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.941683 2548 generic.go:358] "Generic (PLEG): container finished" podID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerID="f8d67866dd9f4f3e373a10e0afc7b49fd4815338a5a5c9ad1fa4a76c78f38cf8" exitCode=0 May 21 02:11:35.941947 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.941775 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" event={"ID":"57caa66b-daca-4d51-832c-3cc886e13c0e","Type":"ContainerDied","Data":"f8d67866dd9f4f3e373a10e0afc7b49fd4815338a5a5c9ad1fa4a76c78f38cf8"} May 21 02:11:35.941947 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:35.941816 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" event={"ID":"57caa66b-daca-4d51-832c-3cc886e13c0e","Type":"ContainerStarted","Data":"e21151cc467223f1851acab3f168455ed7c28b0b3f030c369d9df7a1eb29ac8c"} May 21 02:11:36.998229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:36.998192 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-lqpd5"] May 21 02:11:37.001615 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.001591 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.004431 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.004408 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 02:11:37.005247 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.005214 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g8vp5\"" May 21 02:11:37.005369 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.005353 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 02:11:37.010604 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.010562 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-lqpd5"] May 21 02:11:37.078061 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.078026 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v9cn\" (UniqueName: \"kubernetes.io/projected/f57bbaf3-b057-4896-af1b-ac402f4ccdc8-kube-api-access-9v9cn\") pod \"cert-manager-webhook-587ccfb98-lqpd5\" (UID: \"f57bbaf3-b057-4896-af1b-ac402f4ccdc8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.078267 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.078159 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57bbaf3-b057-4896-af1b-ac402f4ccdc8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-lqpd5\" (UID: \"f57bbaf3-b057-4896-af1b-ac402f4ccdc8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.179430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.179394 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57bbaf3-b057-4896-af1b-ac402f4ccdc8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-lqpd5\" (UID: \"f57bbaf3-b057-4896-af1b-ac402f4ccdc8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.179640 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.179446 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9v9cn\" (UniqueName: \"kubernetes.io/projected/f57bbaf3-b057-4896-af1b-ac402f4ccdc8-kube-api-access-9v9cn\") pod \"cert-manager-webhook-587ccfb98-lqpd5\" (UID: \"f57bbaf3-b057-4896-af1b-ac402f4ccdc8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.187447 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.187421 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v9cn\" (UniqueName: \"kubernetes.io/projected/f57bbaf3-b057-4896-af1b-ac402f4ccdc8-kube-api-access-9v9cn\") pod \"cert-manager-webhook-587ccfb98-lqpd5\" (UID: \"f57bbaf3-b057-4896-af1b-ac402f4ccdc8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.187592 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.187422 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57bbaf3-b057-4896-af1b-ac402f4ccdc8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-lqpd5\" (UID: \"f57bbaf3-b057-4896-af1b-ac402f4ccdc8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:37.319647 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:37.319556 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:38.100662 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:38.100582 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-lqpd5"] May 21 02:11:38.103318 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:38.103290 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf57bbaf3_b057_4896_af1b_ac402f4ccdc8.slice/crio-49f52ebcbe5aa24b389db9fe9e717d856e4e6ac0284ee0e9183a11bd3c9b6960 WatchSource:0}: Error finding container 49f52ebcbe5aa24b389db9fe9e717d856e4e6ac0284ee0e9183a11bd3c9b6960: Status 404 returned error can't find the container with id 49f52ebcbe5aa24b389db9fe9e717d856e4e6ac0284ee0e9183a11bd3c9b6960 May 21 02:11:38.953215 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:38.953178 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" event={"ID":"f57bbaf3-b057-4896-af1b-ac402f4ccdc8","Type":"ContainerStarted","Data":"49f52ebcbe5aa24b389db9fe9e717d856e4e6ac0284ee0e9183a11bd3c9b6960"} May 21 02:11:38.954829 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:38.954803 2548 generic.go:358] "Generic (PLEG): container finished" podID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerID="e3a849db647c53fa9d372bd60db64d0bae5f645d6bc9f197b0685b35416dd5b5" exitCode=0 May 21 02:11:38.954947 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:38.954891 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" event={"ID":"57caa66b-daca-4d51-832c-3cc886e13c0e","Type":"ContainerDied","Data":"e3a849db647c53fa9d372bd60db64d0bae5f645d6bc9f197b0685b35416dd5b5"} May 21 02:11:39.793928 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.793887 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k2vzr"] May 21 02:11:39.797373 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.797351 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:39.799684 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.799656 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hvcfj\"" May 21 02:11:39.805562 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.805433 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k2vzr"] May 21 02:11:39.904730 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.904687 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4772285-888e-4c52-b6a7-6dd405d3ed4f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k2vzr\" (UID: \"a4772285-888e-4c52-b6a7-6dd405d3ed4f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:39.904915 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.904832 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rn79\" (UniqueName: \"kubernetes.io/projected/a4772285-888e-4c52-b6a7-6dd405d3ed4f-kube-api-access-6rn79\") pod \"cert-manager-cainjector-68b757865b-k2vzr\" (UID: \"a4772285-888e-4c52-b6a7-6dd405d3ed4f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:39.960894 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.960857 2548 generic.go:358] "Generic (PLEG): container finished" podID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerID="96c0caf300b350879a45b74ebf6af876abd1b6afcde90792c2b0eef77fd1e007" exitCode=0 May 21 02:11:39.961066 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:39.960903 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" event={"ID":"57caa66b-daca-4d51-832c-3cc886e13c0e","Type":"ContainerDied","Data":"96c0caf300b350879a45b74ebf6af876abd1b6afcde90792c2b0eef77fd1e007"} May 21 02:11:40.006259 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:40.006225 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rn79\" (UniqueName: \"kubernetes.io/projected/a4772285-888e-4c52-b6a7-6dd405d3ed4f-kube-api-access-6rn79\") pod \"cert-manager-cainjector-68b757865b-k2vzr\" (UID: \"a4772285-888e-4c52-b6a7-6dd405d3ed4f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:40.006495 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:40.006282 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4772285-888e-4c52-b6a7-6dd405d3ed4f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k2vzr\" (UID: \"a4772285-888e-4c52-b6a7-6dd405d3ed4f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:40.014597 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:40.014565 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4772285-888e-4c52-b6a7-6dd405d3ed4f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k2vzr\" (UID: \"a4772285-888e-4c52-b6a7-6dd405d3ed4f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:40.014818 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:40.014795 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rn79\" (UniqueName: \"kubernetes.io/projected/a4772285-888e-4c52-b6a7-6dd405d3ed4f-kube-api-access-6rn79\") pod \"cert-manager-cainjector-68b757865b-k2vzr\" (UID: \"a4772285-888e-4c52-b6a7-6dd405d3ed4f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:40.109314 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:40.109236 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" May 21 02:11:40.244936 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:40.244912 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k2vzr"] May 21 02:11:40.977455 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:40.977412 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4772285_888e_4c52_b6a7_6dd405d3ed4f.slice/crio-d6ceb0db2108833366bf54547d58b59733258730d51b8cb71967ea09e83d32a7 WatchSource:0}: Error finding container d6ceb0db2108833366bf54547d58b59733258730d51b8cb71967ea09e83d32a7: Status 404 returned error can't find the container with id d6ceb0db2108833366bf54547d58b59733258730d51b8cb71967ea09e83d32a7 May 21 02:11:41.106618 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.106593 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:41.218907 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.218819 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-bundle\") pod \"57caa66b-daca-4d51-832c-3cc886e13c0e\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " May 21 02:11:41.218907 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.218872 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb7f5\" (UniqueName: \"kubernetes.io/projected/57caa66b-daca-4d51-832c-3cc886e13c0e-kube-api-access-mb7f5\") pod \"57caa66b-daca-4d51-832c-3cc886e13c0e\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " May 21 02:11:41.218907 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.218898 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-util\") pod \"57caa66b-daca-4d51-832c-3cc886e13c0e\" (UID: \"57caa66b-daca-4d51-832c-3cc886e13c0e\") " May 21 02:11:41.219188 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.219162 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-bundle" (OuterVolumeSpecName: "bundle") pod "57caa66b-daca-4d51-832c-3cc886e13c0e" (UID: "57caa66b-daca-4d51-832c-3cc886e13c0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:11:41.220929 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.220897 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57caa66b-daca-4d51-832c-3cc886e13c0e-kube-api-access-mb7f5" (OuterVolumeSpecName: "kube-api-access-mb7f5") pod "57caa66b-daca-4d51-832c-3cc886e13c0e" (UID: "57caa66b-daca-4d51-832c-3cc886e13c0e"). InnerVolumeSpecName "kube-api-access-mb7f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:11:41.223131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.223113 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-util" (OuterVolumeSpecName: "util") pod "57caa66b-daca-4d51-832c-3cc886e13c0e" (UID: "57caa66b-daca-4d51-832c-3cc886e13c0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:11:41.319685 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.319649 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:11:41.319685 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.319679 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb7f5\" (UniqueName: \"kubernetes.io/projected/57caa66b-daca-4d51-832c-3cc886e13c0e-kube-api-access-mb7f5\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:11:41.319685 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.319690 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57caa66b-daca-4d51-832c-3cc886e13c0e-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:11:41.968958 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.968930 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" event={"ID":"f57bbaf3-b057-4896-af1b-ac402f4ccdc8","Type":"ContainerStarted","Data":"099c0b7a17c0eb6f7006ad5aae9659738adcc7d042ea86eb15a83fafeab872cd"} May 21 02:11:41.969111 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.969019 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:41.970627 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.970602 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" May 21 02:11:41.970724 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.970621 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdslk" event={"ID":"57caa66b-daca-4d51-832c-3cc886e13c0e","Type":"ContainerDied","Data":"e21151cc467223f1851acab3f168455ed7c28b0b3f030c369d9df7a1eb29ac8c"} May 21 02:11:41.970724 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.970654 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e21151cc467223f1851acab3f168455ed7c28b0b3f030c369d9df7a1eb29ac8c" May 21 02:11:41.971653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.971627 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" event={"ID":"a4772285-888e-4c52-b6a7-6dd405d3ed4f","Type":"ContainerStarted","Data":"d6ceb0db2108833366bf54547d58b59733258730d51b8cb71967ea09e83d32a7"} May 21 02:11:41.984685 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:41.984643 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" podStartSLOduration=3.04148091 podStartE2EDuration="5.984629977s" podCreationTimestamp="2026-05-21 02:11:36 +0000 UTC" firstStartedPulling="2026-05-21 02:11:38.105202213 +0000 UTC m=+351.868434582" lastFinishedPulling="2026-05-21 02:11:41.04835127 +0000 UTC m=+354.811583649" observedRunningTime="2026-05-21 02:11:41.98291214 +0000 UTC m=+355.746144524" watchObservedRunningTime="2026-05-21 02:11:41.984629977 +0000 UTC m=+355.747862363" May 21 02:11:42.976254 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:42.976219 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" event={"ID":"a4772285-888e-4c52-b6a7-6dd405d3ed4f","Type":"ContainerStarted","Data":"bb0c2b832a79bdf9b66d297f2bd4a52cc4dd0e0a58231aa1d4b2f33ce0994c14"} May 21 02:11:42.991162 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:42.991116 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-k2vzr" podStartSLOduration=3.012403693 podStartE2EDuration="3.991102225s" podCreationTimestamp="2026-05-21 02:11:39 +0000 UTC" firstStartedPulling="2026-05-21 02:11:40.979916559 +0000 UTC m=+354.743148924" lastFinishedPulling="2026-05-21 02:11:41.958615093 +0000 UTC m=+355.721847456" observedRunningTime="2026-05-21 02:11:42.989807227 +0000 UTC m=+356.753039613" watchObservedRunningTime="2026-05-21 02:11:42.991102225 +0000 UTC m=+356.754334611" May 21 02:11:45.874303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874269 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wwnhf"] May 21 02:11:45.874653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874591 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="util" May 21 02:11:45.874653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874602 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="util" May 21 02:11:45.874653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874609 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="extract" May 21 02:11:45.874653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874614 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="extract" May 21 02:11:45.874653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874627 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="pull" May 21 02:11:45.874653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874633 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="pull" May 21 02:11:45.874856 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.874687 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="57caa66b-daca-4d51-832c-3cc886e13c0e" containerName="extract" May 21 02:11:45.877649 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.877633 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:45.880527 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.880509 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-86pr4\"" May 21 02:11:45.899989 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.899964 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wwnhf"] May 21 02:11:45.957955 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.957919 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npbc7\" (UniqueName: \"kubernetes.io/projected/43450bef-f6a6-434b-a245-ba491eb7076b-kube-api-access-npbc7\") pod \"cert-manager-79c8d999ff-wwnhf\" (UID: \"43450bef-f6a6-434b-a245-ba491eb7076b\") " pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:45.958082 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:45.957971 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43450bef-f6a6-434b-a245-ba491eb7076b-bound-sa-token\") pod \"cert-manager-79c8d999ff-wwnhf\" (UID: \"43450bef-f6a6-434b-a245-ba491eb7076b\") " pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:46.058870 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.058839 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npbc7\" (UniqueName: \"kubernetes.io/projected/43450bef-f6a6-434b-a245-ba491eb7076b-kube-api-access-npbc7\") pod \"cert-manager-79c8d999ff-wwnhf\" (UID: \"43450bef-f6a6-434b-a245-ba491eb7076b\") " pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:46.059025 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.058885 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43450bef-f6a6-434b-a245-ba491eb7076b-bound-sa-token\") pod \"cert-manager-79c8d999ff-wwnhf\" (UID: \"43450bef-f6a6-434b-a245-ba491eb7076b\") " pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:46.066872 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.066847 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43450bef-f6a6-434b-a245-ba491eb7076b-bound-sa-token\") pod \"cert-manager-79c8d999ff-wwnhf\" (UID: \"43450bef-f6a6-434b-a245-ba491eb7076b\") " pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:46.067118 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.067098 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npbc7\" (UniqueName: \"kubernetes.io/projected/43450bef-f6a6-434b-a245-ba491eb7076b-kube-api-access-npbc7\") pod \"cert-manager-79c8d999ff-wwnhf\" (UID: \"43450bef-f6a6-434b-a245-ba491eb7076b\") " pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:46.186290 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.186204 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-wwnhf" May 21 02:11:46.323390 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.323286 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-wwnhf"] May 21 02:11:46.325536 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:46.325509 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43450bef_f6a6_434b_a245_ba491eb7076b.slice/crio-e7de2a6b3c29a7f5153def1eca5c953bb97032bc13f412fe0d98ab9b15d52bfb WatchSource:0}: Error finding container e7de2a6b3c29a7f5153def1eca5c953bb97032bc13f412fe0d98ab9b15d52bfb: Status 404 returned error can't find the container with id e7de2a6b3c29a7f5153def1eca5c953bb97032bc13f412fe0d98ab9b15d52bfb May 21 02:11:46.990597 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.990560 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-wwnhf" event={"ID":"43450bef-f6a6-434b-a245-ba491eb7076b","Type":"ContainerStarted","Data":"432eba737cc15f295244c6339cc2355a0dd8a4d09af5ceece3cf6bcb1e450325"} May 21 02:11:46.990597 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:46.990599 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-wwnhf" event={"ID":"43450bef-f6a6-434b-a245-ba491eb7076b","Type":"ContainerStarted","Data":"e7de2a6b3c29a7f5153def1eca5c953bb97032bc13f412fe0d98ab9b15d52bfb"} May 21 02:11:47.006931 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:47.006888 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-wwnhf" podStartSLOduration=2.006875213 podStartE2EDuration="2.006875213s" podCreationTimestamp="2026-05-21 02:11:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:11:47.005061205 +0000 UTC m=+360.768293590" watchObservedRunningTime="2026-05-21 02:11:47.006875213 +0000 UTC m=+360.770107598" May 21 02:11:47.978682 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:47.978650 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-lqpd5" May 21 02:11:54.575598 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.575566 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx"] May 21 02:11:54.579209 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.579191 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.581675 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.581655 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 02:11:54.582470 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.582449 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 02:11:54.582470 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.582459 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z54tb\"" May 21 02:11:54.585236 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.585212 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx"] May 21 02:11:54.634013 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.633982 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndwf\" (UniqueName: \"kubernetes.io/projected/91e268a6-8ac6-4e3e-8921-c083b8add3db-kube-api-access-9ndwf\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.634139 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.634026 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.634139 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.634048 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.734463 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.734431 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndwf\" (UniqueName: \"kubernetes.io/projected/91e268a6-8ac6-4e3e-8921-c083b8add3db-kube-api-access-9ndwf\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.734576 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.734477 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.734576 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.734517 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.734922 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.734902 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.734961 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.734928 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.741987 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.741965 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndwf\" (UniqueName: \"kubernetes.io/projected/91e268a6-8ac6-4e3e-8921-c083b8add3db-kube-api-access-9ndwf\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:54.889528 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:54.889460 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:11:55.012407 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:55.012264 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx"] May 21 02:11:55.015152 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:11:55.015126 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e268a6_8ac6_4e3e_8921_c083b8add3db.slice/crio-1c15805a1c18324146013d2ba4c293204e0aa51bb0c81a9c1de86d5fdebac86c WatchSource:0}: Error finding container 1c15805a1c18324146013d2ba4c293204e0aa51bb0c81a9c1de86d5fdebac86c: Status 404 returned error can't find the container with id 1c15805a1c18324146013d2ba4c293204e0aa51bb0c81a9c1de86d5fdebac86c May 21 02:11:56.022233 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:56.022149 2548 generic.go:358] "Generic (PLEG): container finished" podID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerID="6a6839075293293d037982bf720f4cb81ec1522789112cd75d66c566d38da21a" exitCode=0 May 21 02:11:56.022233 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:56.022190 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" event={"ID":"91e268a6-8ac6-4e3e-8921-c083b8add3db","Type":"ContainerDied","Data":"6a6839075293293d037982bf720f4cb81ec1522789112cd75d66c566d38da21a"} May 21 02:11:56.022233 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:56.022212 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" event={"ID":"91e268a6-8ac6-4e3e-8921-c083b8add3db","Type":"ContainerStarted","Data":"1c15805a1c18324146013d2ba4c293204e0aa51bb0c81a9c1de86d5fdebac86c"} May 21 02:11:58.030346 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:58.030312 2548 generic.go:358] "Generic (PLEG): container finished" podID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerID="fc11ddc50c070455215ecd02e1f67ff2c8b58bd555d54ad7b5aea69bf8f4967f" exitCode=0 May 21 02:11:58.030807 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:58.030399 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" event={"ID":"91e268a6-8ac6-4e3e-8921-c083b8add3db","Type":"ContainerDied","Data":"fc11ddc50c070455215ecd02e1f67ff2c8b58bd555d54ad7b5aea69bf8f4967f"} May 21 02:11:59.035046 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:59.035008 2548 generic.go:358] "Generic (PLEG): container finished" podID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerID="33d6bd0a90bc2d38346a4d875c6b38624df8f34cc881b06a865e115183afaeac" exitCode=0 May 21 02:11:59.035407 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:11:59.035054 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" event={"ID":"91e268a6-8ac6-4e3e-8921-c083b8add3db","Type":"ContainerDied","Data":"33d6bd0a90bc2d38346a4d875c6b38624df8f34cc881b06a865e115183afaeac"} May 21 02:12:00.161788 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.161768 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:12:00.281702 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.281669 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-util\") pod \"91e268a6-8ac6-4e3e-8921-c083b8add3db\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " May 21 02:12:00.281926 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.281732 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ndwf\" (UniqueName: \"kubernetes.io/projected/91e268a6-8ac6-4e3e-8921-c083b8add3db-kube-api-access-9ndwf\") pod \"91e268a6-8ac6-4e3e-8921-c083b8add3db\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " May 21 02:12:00.281926 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.281812 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-bundle\") pod \"91e268a6-8ac6-4e3e-8921-c083b8add3db\" (UID: \"91e268a6-8ac6-4e3e-8921-c083b8add3db\") " May 21 02:12:00.282530 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.282498 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-bundle" (OuterVolumeSpecName: "bundle") pod "91e268a6-8ac6-4e3e-8921-c083b8add3db" (UID: "91e268a6-8ac6-4e3e-8921-c083b8add3db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:00.283922 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.283894 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e268a6-8ac6-4e3e-8921-c083b8add3db-kube-api-access-9ndwf" (OuterVolumeSpecName: "kube-api-access-9ndwf") pod "91e268a6-8ac6-4e3e-8921-c083b8add3db" (UID: "91e268a6-8ac6-4e3e-8921-c083b8add3db"). InnerVolumeSpecName "kube-api-access-9ndwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:12:00.287697 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.287676 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-util" (OuterVolumeSpecName: "util") pod "91e268a6-8ac6-4e3e-8921-c083b8add3db" (UID: "91e268a6-8ac6-4e3e-8921-c083b8add3db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:00.383454 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.383362 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:00.383454 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.383403 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ndwf\" (UniqueName: \"kubernetes.io/projected/91e268a6-8ac6-4e3e-8921-c083b8add3db-kube-api-access-9ndwf\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:00.383454 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:00.383414 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e268a6-8ac6-4e3e-8921-c083b8add3db-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:01.042611 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:01.042581 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" May 21 02:12:01.042800 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:01.042577 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ctcwx" event={"ID":"91e268a6-8ac6-4e3e-8921-c083b8add3db","Type":"ContainerDied","Data":"1c15805a1c18324146013d2ba4c293204e0aa51bb0c81a9c1de86d5fdebac86c"} May 21 02:12:01.042800 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:01.042689 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c15805a1c18324146013d2ba4c293204e0aa51bb0c81a9c1de86d5fdebac86c" May 21 02:12:07.598878 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.598839 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd"] May 21 02:12:07.599441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599295 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="extract" May 21 02:12:07.599441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599314 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="extract" May 21 02:12:07.599441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599338 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="pull" May 21 02:12:07.599441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599347 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="pull" May 21 02:12:07.599441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599372 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="util" May 21 02:12:07.599441 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599380 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="util" May 21 02:12:07.599770 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.599457 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="91e268a6-8ac6-4e3e-8921-c083b8add3db" containerName="extract" May 21 02:12:07.602657 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.602637 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.604996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.604972 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 02:12:07.605144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.605005 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z54tb\"" May 21 02:12:07.605144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.604980 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 02:12:07.609653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.609631 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd"] May 21 02:12:07.746165 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.746124 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdf6r\" (UniqueName: \"kubernetes.io/projected/29ad0ec8-62c0-47b0-9594-676705de6fdd-kube-api-access-vdf6r\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.746357 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.746169 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.746357 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.746218 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.847567 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.847527 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdf6r\" (UniqueName: \"kubernetes.io/projected/29ad0ec8-62c0-47b0-9594-676705de6fdd-kube-api-access-vdf6r\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.847567 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.847571 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.847863 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.847588 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.847962 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.847945 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.848063 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.848042 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.854996 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.854940 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdf6r\" (UniqueName: \"kubernetes.io/projected/29ad0ec8-62c0-47b0-9594-676705de6fdd-kube-api-access-vdf6r\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:07.912921 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:07.912893 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:08.047212 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:08.047169 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd"] May 21 02:12:08.053201 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:12:08.053173 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ad0ec8_62c0_47b0_9594_676705de6fdd.slice/crio-1d50ed3c4298d6a72ad735380be699dd256eef56a8e1cdf4335ce67be62942ed WatchSource:0}: Error finding container 1d50ed3c4298d6a72ad735380be699dd256eef56a8e1cdf4335ce67be62942ed: Status 404 returned error can't find the container with id 1d50ed3c4298d6a72ad735380be699dd256eef56a8e1cdf4335ce67be62942ed May 21 02:12:08.070989 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:08.070950 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" event={"ID":"29ad0ec8-62c0-47b0-9594-676705de6fdd","Type":"ContainerStarted","Data":"1d50ed3c4298d6a72ad735380be699dd256eef56a8e1cdf4335ce67be62942ed"} May 21 02:12:09.076248 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.076210 2548 generic.go:358] "Generic (PLEG): container finished" podID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerID="a3907a44c12e38bdb29cc4841628e1d863a27e54ac839f836e621cac2614e467" exitCode=0 May 21 02:12:09.076617 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.076298 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" event={"ID":"29ad0ec8-62c0-47b0-9594-676705de6fdd","Type":"ContainerDied","Data":"a3907a44c12e38bdb29cc4841628e1d863a27e54ac839f836e621cac2614e467"} May 21 02:12:09.587374 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.587339 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt"] May 21 02:12:09.591931 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.591910 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.594297 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.594281 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 02:12:09.594419 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.594318 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 02:12:09.594419 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.594328 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 02:12:09.594419 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.594369 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 02:12:09.594579 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.594433 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rlcrz\"" May 21 02:12:09.609128 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.609101 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt"] May 21 02:12:09.765955 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.765922 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pzzs\" (UniqueName: \"kubernetes.io/projected/b43c8d26-6106-4acd-9fbd-ab69c2be2374-kube-api-access-9pzzs\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.766111 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.765966 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b43c8d26-6106-4acd-9fbd-ab69c2be2374-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.766111 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.765991 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43c8d26-6106-4acd-9fbd-ab69c2be2374-webhook-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.866527 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.866434 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pzzs\" (UniqueName: \"kubernetes.io/projected/b43c8d26-6106-4acd-9fbd-ab69c2be2374-kube-api-access-9pzzs\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.866527 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.866476 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b43c8d26-6106-4acd-9fbd-ab69c2be2374-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.866527 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.866497 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43c8d26-6106-4acd-9fbd-ab69c2be2374-webhook-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.868936 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.868912 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43c8d26-6106-4acd-9fbd-ab69c2be2374-webhook-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.869059 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.868956 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b43c8d26-6106-4acd-9fbd-ab69c2be2374-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.874846 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.874818 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pzzs\" (UniqueName: \"kubernetes.io/projected/b43c8d26-6106-4acd-9fbd-ab69c2be2374-kube-api-access-9pzzs\") pod \"opendatahub-operator-controller-manager-784fb9f5c5-565xt\" (UID: \"b43c8d26-6106-4acd-9fbd-ab69c2be2374\") " pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:09.902354 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:09.902333 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:10.036117 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:10.036092 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt"] May 21 02:12:10.039009 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:12:10.038974 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43c8d26_6106_4acd_9fbd_ab69c2be2374.slice/crio-a1a285d08e62761bbded38b14a985d3007459e5b0bd8ece13830b757e1fd8480 WatchSource:0}: Error finding container a1a285d08e62761bbded38b14a985d3007459e5b0bd8ece13830b757e1fd8480: Status 404 returned error can't find the container with id a1a285d08e62761bbded38b14a985d3007459e5b0bd8ece13830b757e1fd8480 May 21 02:12:10.081303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:10.081266 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" event={"ID":"b43c8d26-6106-4acd-9fbd-ab69c2be2374","Type":"ContainerStarted","Data":"a1a285d08e62761bbded38b14a985d3007459e5b0bd8ece13830b757e1fd8480"} May 21 02:12:10.083001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:10.082971 2548 generic.go:358] "Generic (PLEG): container finished" podID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerID="53ee48ac21dea31831c07f178f03bb7f74787c4ffa1a966039ec5b377ba9f61f" exitCode=0 May 21 02:12:10.083125 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:10.083025 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" event={"ID":"29ad0ec8-62c0-47b0-9594-676705de6fdd","Type":"ContainerDied","Data":"53ee48ac21dea31831c07f178f03bb7f74787c4ffa1a966039ec5b377ba9f61f"} May 21 02:12:11.088234 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:11.088200 2548 generic.go:358] "Generic (PLEG): container finished" podID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerID="9cfcb6525bd8f9b55f301f65c11ef6c7df8e503aaca9ed7780b9b13329a537c7" exitCode=0 May 21 02:12:11.088607 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:11.088290 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" event={"ID":"29ad0ec8-62c0-47b0-9594-676705de6fdd","Type":"ContainerDied","Data":"9cfcb6525bd8f9b55f301f65c11ef6c7df8e503aaca9ed7780b9b13329a537c7"} May 21 02:12:12.598732 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.598708 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:12.792014 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.791978 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdf6r\" (UniqueName: \"kubernetes.io/projected/29ad0ec8-62c0-47b0-9594-676705de6fdd-kube-api-access-vdf6r\") pod \"29ad0ec8-62c0-47b0-9594-676705de6fdd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " May 21 02:12:12.792199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.792064 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-bundle\") pod \"29ad0ec8-62c0-47b0-9594-676705de6fdd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " May 21 02:12:12.792199 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.792112 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-util\") pod \"29ad0ec8-62c0-47b0-9594-676705de6fdd\" (UID: \"29ad0ec8-62c0-47b0-9594-676705de6fdd\") " May 21 02:12:12.792807 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.792730 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-bundle" (OuterVolumeSpecName: "bundle") pod "29ad0ec8-62c0-47b0-9594-676705de6fdd" (UID: "29ad0ec8-62c0-47b0-9594-676705de6fdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:12.794362 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.794332 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ad0ec8-62c0-47b0-9594-676705de6fdd-kube-api-access-vdf6r" (OuterVolumeSpecName: "kube-api-access-vdf6r") pod "29ad0ec8-62c0-47b0-9594-676705de6fdd" (UID: "29ad0ec8-62c0-47b0-9594-676705de6fdd"). InnerVolumeSpecName "kube-api-access-vdf6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:12:12.798006 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.797982 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-util" (OuterVolumeSpecName: "util") pod "29ad0ec8-62c0-47b0-9594-676705de6fdd" (UID: "29ad0ec8-62c0-47b0-9594-676705de6fdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:12.892979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.892949 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:12.892979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.892973 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29ad0ec8-62c0-47b0-9594-676705de6fdd-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:12.892979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:12.892983 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdf6r\" (UniqueName: \"kubernetes.io/projected/29ad0ec8-62c0-47b0-9594-676705de6fdd-kube-api-access-vdf6r\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:13.101819 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:13.101779 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" event={"ID":"b43c8d26-6106-4acd-9fbd-ab69c2be2374","Type":"ContainerStarted","Data":"08713a8db66342c0ab22becc0b5dc9eb049cbe9ef0d233a6d2692060e0c4083e"} May 21 02:12:13.101995 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:13.101938 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:13.103469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:13.103448 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" event={"ID":"29ad0ec8-62c0-47b0-9594-676705de6fdd","Type":"ContainerDied","Data":"1d50ed3c4298d6a72ad735380be699dd256eef56a8e1cdf4335ce67be62942ed"} May 21 02:12:13.103469 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:13.103470 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d50ed3c4298d6a72ad735380be699dd256eef56a8e1cdf4335ce67be62942ed" May 21 02:12:13.103618 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:13.103508 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sbdtd" May 21 02:12:13.121727 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:13.121644 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" podStartSLOduration=1.554956887 podStartE2EDuration="4.121631995s" podCreationTimestamp="2026-05-21 02:12:09 +0000 UTC" firstStartedPulling="2026-05-21 02:12:10.040867517 +0000 UTC m=+383.804099884" lastFinishedPulling="2026-05-21 02:12:12.607542627 +0000 UTC m=+386.370774992" observedRunningTime="2026-05-21 02:12:13.119365163 +0000 UTC m=+386.882597575" watchObservedRunningTime="2026-05-21 02:12:13.121631995 +0000 UTC m=+386.884864379" May 21 02:12:15.570571 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570534 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx"] May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570863 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="util" May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570874 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="util" May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570880 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="pull" May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570885 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="pull" May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570904 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="extract" May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570910 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="extract" May 21 02:12:15.570973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.570964 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="29ad0ec8-62c0-47b0-9594-676705de6fdd" containerName="extract" May 21 02:12:15.573338 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.573322 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.575950 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.575930 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 02:12:15.576052 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.575973 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 02:12:15.576822 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.576806 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 02:12:15.576916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.576806 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 02:12:15.577063 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.577050 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 02:12:15.577183 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.577164 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d4lm5\"" May 21 02:12:15.581997 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.581977 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx"] May 21 02:12:15.716593 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.716560 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30e65342-dbb2-4922-a957-5184d93bb004-metrics-cert\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.716593 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.716600 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30e65342-dbb2-4922-a957-5184d93bb004-cert\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.716854 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.716619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkh77\" (UniqueName: \"kubernetes.io/projected/30e65342-dbb2-4922-a957-5184d93bb004-kube-api-access-zkh77\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.716854 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.716777 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30e65342-dbb2-4922-a957-5184d93bb004-manager-config\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.817285 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.817242 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30e65342-dbb2-4922-a957-5184d93bb004-cert\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.817285 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.817289 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkh77\" (UniqueName: \"kubernetes.io/projected/30e65342-dbb2-4922-a957-5184d93bb004-kube-api-access-zkh77\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.817529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.817342 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30e65342-dbb2-4922-a957-5184d93bb004-manager-config\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.817529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.817384 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30e65342-dbb2-4922-a957-5184d93bb004-metrics-cert\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.818051 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.818025 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30e65342-dbb2-4922-a957-5184d93bb004-manager-config\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.819782 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.819759 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30e65342-dbb2-4922-a957-5184d93bb004-cert\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.819872 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.819818 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30e65342-dbb2-4922-a957-5184d93bb004-metrics-cert\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.827010 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.826960 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkh77\" (UniqueName: \"kubernetes.io/projected/30e65342-dbb2-4922-a957-5184d93bb004-kube-api-access-zkh77\") pod \"lws-controller-manager-6c674d5855-4cllx\" (UID: \"30e65342-dbb2-4922-a957-5184d93bb004\") " pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:15.883245 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:15.883219 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:16.012594 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:16.012568 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx"] May 21 02:12:16.014668 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:12:16.014628 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e65342_dbb2_4922_a957_5184d93bb004.slice/crio-62d76c765b7cb12113158cb1cac0236ed8200c13919d044d95c06490e493b29f WatchSource:0}: Error finding container 62d76c765b7cb12113158cb1cac0236ed8200c13919d044d95c06490e493b29f: Status 404 returned error can't find the container with id 62d76c765b7cb12113158cb1cac0236ed8200c13919d044d95c06490e493b29f May 21 02:12:16.117324 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:16.117236 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" event={"ID":"30e65342-dbb2-4922-a957-5184d93bb004","Type":"ContainerStarted","Data":"62d76c765b7cb12113158cb1cac0236ed8200c13919d044d95c06490e493b29f"} May 21 02:12:18.126485 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:18.126450 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" event={"ID":"30e65342-dbb2-4922-a957-5184d93bb004","Type":"ContainerStarted","Data":"f8d5e9c907b10274d894180e0ff1bac09ba1e1092b42687d985073e6e522bc18"} May 21 02:12:18.126971 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:18.126560 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:18.144165 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:18.144106 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" podStartSLOduration=1.527110924 podStartE2EDuration="3.144088063s" podCreationTimestamp="2026-05-21 02:12:15 +0000 UTC" firstStartedPulling="2026-05-21 02:12:16.016321724 +0000 UTC m=+389.779554087" lastFinishedPulling="2026-05-21 02:12:17.633298859 +0000 UTC m=+391.396531226" observedRunningTime="2026-05-21 02:12:18.143154165 +0000 UTC m=+391.906386553" watchObservedRunningTime="2026-05-21 02:12:18.144088063 +0000 UTC m=+391.907320455" May 21 02:12:24.111638 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:24.111610 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-784fb9f5c5-565xt" May 21 02:12:29.132574 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:29.132547 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c674d5855-4cllx" May 21 02:12:37.451330 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.451293 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26"] May 21 02:12:37.453639 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.453623 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.455901 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.455882 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 02:12:37.456624 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.456610 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 02:12:37.456670 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.456613 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z54tb\"" May 21 02:12:37.469785 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.469736 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26"] May 21 02:12:37.474916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.474886 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.475040 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.475016 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clx6c\" (UniqueName: \"kubernetes.io/projected/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-kube-api-access-clx6c\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.475104 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.475086 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.576249 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.576208 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.576422 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.576321 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clx6c\" (UniqueName: \"kubernetes.io/projected/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-kube-api-access-clx6c\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.576422 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.576356 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.576659 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.576635 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.576807 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.576787 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.585240 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.585217 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clx6c\" (UniqueName: \"kubernetes.io/projected/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-kube-api-access-clx6c\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.763930 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.763891 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:37.890701 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:37.890565 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26"] May 21 02:12:37.893148 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:12:37.893121 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcedca4c7_b1ee_45a5_a55f_0f3626fa6c8b.slice/crio-9239fe5032204b1b4d0548dbe938d4c69e6d47ff597850fc007fce31d24e4928 WatchSource:0}: Error finding container 9239fe5032204b1b4d0548dbe938d4c69e6d47ff597850fc007fce31d24e4928: Status 404 returned error can't find the container with id 9239fe5032204b1b4d0548dbe938d4c69e6d47ff597850fc007fce31d24e4928 May 21 02:12:38.196599 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:38.196510 2548 generic.go:358] "Generic (PLEG): container finished" podID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerID="2c7df9054fc3847cc65c5cd74c720281f394e647183921a4a4d8d7af357abbfe" exitCode=0 May 21 02:12:38.196827 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:38.196603 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" event={"ID":"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b","Type":"ContainerDied","Data":"2c7df9054fc3847cc65c5cd74c720281f394e647183921a4a4d8d7af357abbfe"} May 21 02:12:38.196827 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:38.196640 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" event={"ID":"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b","Type":"ContainerStarted","Data":"9239fe5032204b1b4d0548dbe938d4c69e6d47ff597850fc007fce31d24e4928"} May 21 02:12:40.204569 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:40.204527 2548 generic.go:358] "Generic (PLEG): container finished" podID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerID="3b694538a3120010e1a2c211a226b86b22c26f750ccb0aae5d8c06025d1b4bf1" exitCode=0 May 21 02:12:40.205110 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:40.204601 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" event={"ID":"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b","Type":"ContainerDied","Data":"3b694538a3120010e1a2c211a226b86b22c26f750ccb0aae5d8c06025d1b4bf1"} May 21 02:12:41.209634 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:41.209601 2548 generic.go:358] "Generic (PLEG): container finished" podID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerID="a335c67dfa998613f6bb681615949f67097cfa3c916279918be0ced3ed42bdaf" exitCode=0 May 21 02:12:41.210043 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:41.209690 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" event={"ID":"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b","Type":"ContainerDied","Data":"a335c67dfa998613f6bb681615949f67097cfa3c916279918be0ced3ed42bdaf"} May 21 02:12:42.342931 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.342905 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:42.418192 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.418163 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-util\") pod \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " May 21 02:12:42.418379 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.418225 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-bundle\") pod \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " May 21 02:12:42.418379 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.418291 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clx6c\" (UniqueName: \"kubernetes.io/projected/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-kube-api-access-clx6c\") pod \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\" (UID: \"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b\") " May 21 02:12:42.419074 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.419041 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-bundle" (OuterVolumeSpecName: "bundle") pod "cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" (UID: "cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:42.420352 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.420331 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-kube-api-access-clx6c" (OuterVolumeSpecName: "kube-api-access-clx6c") pod "cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" (UID: "cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b"). InnerVolumeSpecName "kube-api-access-clx6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:12:42.423974 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.423951 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-util" (OuterVolumeSpecName: "util") pod "cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" (UID: "cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:42.519868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.519832 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clx6c\" (UniqueName: \"kubernetes.io/projected/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-kube-api-access-clx6c\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:42.519868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.519863 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:42.519868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:42.519874 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:43.218645 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:43.218560 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" May 21 02:12:43.218645 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:43.218572 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxn26" event={"ID":"cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b","Type":"ContainerDied","Data":"9239fe5032204b1b4d0548dbe938d4c69e6d47ff597850fc007fce31d24e4928"} May 21 02:12:43.218645 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:43.218609 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9239fe5032204b1b4d0548dbe938d4c69e6d47ff597850fc007fce31d24e4928" May 21 02:12:51.643630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643592 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz"] May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643934 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="util" May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643946 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="util" May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643979 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="pull" May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643985 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="pull" May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643992 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="extract" May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.643997 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="extract" May 21 02:12:51.644054 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.644052 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="cedca4c7-b1ee-45a5-a55f-0f3626fa6c8b" containerName="extract" May 21 02:12:51.649787 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.649771 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.652953 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.652929 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 02:12:51.653143 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.652990 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z54tb\"" May 21 02:12:51.653499 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.653479 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 02:12:51.654195 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.654173 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz"] May 21 02:12:51.702931 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.702902 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.703090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.702968 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.703090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.703007 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkgwt\" (UniqueName: \"kubernetes.io/projected/b03eea38-95fb-4f2d-8785-8cfa60a8f061-kube-api-access-rkgwt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.804109 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.804073 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.804285 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.804144 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.804285 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.804166 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgwt\" (UniqueName: \"kubernetes.io/projected/b03eea38-95fb-4f2d-8785-8cfa60a8f061-kube-api-access-rkgwt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.804513 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.804488 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.804552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.804498 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.812628 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.812606 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkgwt\" (UniqueName: \"kubernetes.io/projected/b03eea38-95fb-4f2d-8785-8cfa60a8f061-kube-api-access-rkgwt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:51.959995 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:51.959900 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:52.102673 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:52.102646 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz"] May 21 02:12:52.104428 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:12:52.104398 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03eea38_95fb_4f2d_8785_8cfa60a8f061.slice/crio-1734628dd9f6e653638d5804cf31680f344656f466a5fdb9e80bd6b0b68ff83b WatchSource:0}: Error finding container 1734628dd9f6e653638d5804cf31680f344656f466a5fdb9e80bd6b0b68ff83b: Status 404 returned error can't find the container with id 1734628dd9f6e653638d5804cf31680f344656f466a5fdb9e80bd6b0b68ff83b May 21 02:12:52.252420 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:52.252390 2548 generic.go:358] "Generic (PLEG): container finished" podID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerID="747a0e6ac4d30180243ee6d8fbd9e0f8487552bbfa6b5da33d841dbc505db7bd" exitCode=0 May 21 02:12:52.252601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:52.252477 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" event={"ID":"b03eea38-95fb-4f2d-8785-8cfa60a8f061","Type":"ContainerDied","Data":"747a0e6ac4d30180243ee6d8fbd9e0f8487552bbfa6b5da33d841dbc505db7bd"} May 21 02:12:52.252601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:52.252525 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" event={"ID":"b03eea38-95fb-4f2d-8785-8cfa60a8f061","Type":"ContainerStarted","Data":"1734628dd9f6e653638d5804cf31680f344656f466a5fdb9e80bd6b0b68ff83b"} May 21 02:12:53.257336 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:53.257301 2548 generic.go:358] "Generic (PLEG): container finished" podID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerID="3184bde28847c6be34c6c83e067a53ca8bcd0fba725f991581ce07e61f696978" exitCode=0 May 21 02:12:53.257763 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:53.257388 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" event={"ID":"b03eea38-95fb-4f2d-8785-8cfa60a8f061","Type":"ContainerDied","Data":"3184bde28847c6be34c6c83e067a53ca8bcd0fba725f991581ce07e61f696978"} May 21 02:12:54.262336 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:54.262304 2548 generic.go:358] "Generic (PLEG): container finished" podID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerID="b28ee20008ab9651c202ef913e59e109dc7a8f0ad309413ff8e683b821d43d97" exitCode=0 May 21 02:12:54.262730 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:54.262359 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" event={"ID":"b03eea38-95fb-4f2d-8785-8cfa60a8f061","Type":"ContainerDied","Data":"b28ee20008ab9651c202ef913e59e109dc7a8f0ad309413ff8e683b821d43d97"} May 21 02:12:55.391975 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.391949 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:12:55.537547 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.537453 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-util\") pod \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " May 21 02:12:55.537547 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.537518 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-bundle\") pod \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " May 21 02:12:55.537547 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.537543 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkgwt\" (UniqueName: \"kubernetes.io/projected/b03eea38-95fb-4f2d-8785-8cfa60a8f061-kube-api-access-rkgwt\") pod \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\" (UID: \"b03eea38-95fb-4f2d-8785-8cfa60a8f061\") " May 21 02:12:55.538473 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.538443 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-bundle" (OuterVolumeSpecName: "bundle") pod "b03eea38-95fb-4f2d-8785-8cfa60a8f061" (UID: "b03eea38-95fb-4f2d-8785-8cfa60a8f061"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:55.539670 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.539649 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b03eea38-95fb-4f2d-8785-8cfa60a8f061-kube-api-access-rkgwt" (OuterVolumeSpecName: "kube-api-access-rkgwt") pod "b03eea38-95fb-4f2d-8785-8cfa60a8f061" (UID: "b03eea38-95fb-4f2d-8785-8cfa60a8f061"). InnerVolumeSpecName "kube-api-access-rkgwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:12:55.543178 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.543143 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-util" (OuterVolumeSpecName: "util") pod "b03eea38-95fb-4f2d-8785-8cfa60a8f061" (UID: "b03eea38-95fb-4f2d-8785-8cfa60a8f061"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:12:55.638112 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.638078 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:55.638112 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.638107 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b03eea38-95fb-4f2d-8785-8cfa60a8f061-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:55.638112 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:55.638117 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkgwt\" (UniqueName: \"kubernetes.io/projected/b03eea38-95fb-4f2d-8785-8cfa60a8f061-kube-api-access-rkgwt\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:12:56.271009 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:56.270963 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" event={"ID":"b03eea38-95fb-4f2d-8785-8cfa60a8f061","Type":"ContainerDied","Data":"1734628dd9f6e653638d5804cf31680f344656f466a5fdb9e80bd6b0b68ff83b"} May 21 02:12:56.271009 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:56.271009 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1734628dd9f6e653638d5804cf31680f344656f466a5fdb9e80bd6b0b68ff83b" May 21 02:12:56.271216 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:12:56.271023 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbsqz" May 21 02:13:12.025134 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.025042 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb"] May 21 02:13:12.025975 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.025952 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="pull" May 21 02:13:12.025975 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.025972 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="pull" May 21 02:13:12.026145 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.025995 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="util" May 21 02:13:12.026145 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.026001 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="util" May 21 02:13:12.026145 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.026007 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="extract" May 21 02:13:12.026145 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.026012 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="extract" May 21 02:13:12.026145 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.026066 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="b03eea38-95fb-4f2d-8785-8cfa60a8f061" containerName="extract" May 21 02:13:12.029133 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.029111 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.031494 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.031468 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4vdzl\"" May 21 02:13:12.031494 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.031486 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 02:13:12.031697 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.031670 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 02:13:12.031835 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.031765 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 02:13:12.039074 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.039043 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb"] May 21 02:13:12.180517 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180477 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180517 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180521 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180586 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqqfl\" (UniqueName: \"kubernetes.io/projected/b8704348-f4f5-405d-9b1d-e20bf470ae0f-kube-api-access-cqqfl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180611 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180671 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180703 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180774 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.180812 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180804 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.181044 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.180868 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.281905 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.281947 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.281981 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqqfl\" (UniqueName: \"kubernetes.io/projected/b8704348-f4f5-405d-9b1d-e20bf470ae0f-kube-api-access-cqqfl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282007 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282047 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282081 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282116 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282142 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282194 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282582 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282542 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282637 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282592 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282689 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282638 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282689 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282656 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.282865 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.282847 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.284285 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.284265 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.284557 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.284536 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.289316 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.289294 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8704348-f4f5-405d-9b1d-e20bf470ae0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.289436 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.289420 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqqfl\" (UniqueName: \"kubernetes.io/projected/b8704348-f4f5-405d-9b1d-e20bf470ae0f-kube-api-access-cqqfl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bchkvb\" (UID: \"b8704348-f4f5-405d-9b1d-e20bf470ae0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.345023 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.344976 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:12.502070 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:12.502044 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb"] May 21 02:13:12.505920 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:12.505890 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8704348_f4f5_405d_9b1d_e20bf470ae0f.slice/crio-6952cb67681c4b9fd588324965dbacf44831e993dc5d693686dbb2f4a286a9e6 WatchSource:0}: Error finding container 6952cb67681c4b9fd588324965dbacf44831e993dc5d693686dbb2f4a286a9e6: Status 404 returned error can't find the container with id 6952cb67681c4b9fd588324965dbacf44831e993dc5d693686dbb2f4a286a9e6 May 21 02:13:13.332826 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:13.332784 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" event={"ID":"b8704348-f4f5-405d-9b1d-e20bf470ae0f","Type":"ContainerStarted","Data":"6952cb67681c4b9fd588324965dbacf44831e993dc5d693686dbb2f4a286a9e6"} May 21 02:13:14.907693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:14.907646 2548 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 02:13:14.908169 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:14.907724 2548 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 02:13:14.908169 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:14.907766 2548 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 02:13:15.342281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:15.342243 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" event={"ID":"b8704348-f4f5-405d-9b1d-e20bf470ae0f","Type":"ContainerStarted","Data":"8ab19bd5019c42fd2af66209bb88604be790c1671bf975c1379208d7d79df12a"} May 21 02:13:15.345538 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:15.345520 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:15.349938 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:15.349917 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:15.363693 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:15.363645 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" podStartSLOduration=0.964322834 podStartE2EDuration="3.36363305s" podCreationTimestamp="2026-05-21 02:13:12 +0000 UTC" firstStartedPulling="2026-05-21 02:13:12.508071617 +0000 UTC m=+446.271303984" lastFinishedPulling="2026-05-21 02:13:14.907381834 +0000 UTC m=+448.670614200" observedRunningTime="2026-05-21 02:13:15.359910122 +0000 UTC m=+449.123142507" watchObservedRunningTime="2026-05-21 02:13:15.36363305 +0000 UTC m=+449.126865435" May 21 02:13:16.345897 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:16.345859 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:16.346772 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:16.346736 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bchkvb" May 21 02:13:27.051543 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.051508 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46rrn"] May 21 02:13:27.055219 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.055200 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:27.057734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.057717 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 02:13:27.058783 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.058739 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-c9jgx\"" May 21 02:13:27.058897 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.058739 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 02:13:27.061845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.061819 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46rrn"] May 21 02:13:27.112991 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.112954 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zx5c\" (UniqueName: \"kubernetes.io/projected/92e6e36f-938c-465f-8c2f-d8512bdc7148-kube-api-access-2zx5c\") pod \"kuadrant-operator-catalog-46rrn\" (UID: \"92e6e36f-938c-465f-8c2f-d8512bdc7148\") " pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:27.213673 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.213632 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zx5c\" (UniqueName: \"kubernetes.io/projected/92e6e36f-938c-465f-8c2f-d8512bdc7148-kube-api-access-2zx5c\") pod \"kuadrant-operator-catalog-46rrn\" (UID: \"92e6e36f-938c-465f-8c2f-d8512bdc7148\") " pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:27.222472 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.222445 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zx5c\" (UniqueName: \"kubernetes.io/projected/92e6e36f-938c-465f-8c2f-d8512bdc7148-kube-api-access-2zx5c\") pod \"kuadrant-operator-catalog-46rrn\" (UID: \"92e6e36f-938c-465f-8c2f-d8512bdc7148\") " pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:27.365728 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.365651 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:27.426688 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.426654 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46rrn"] May 21 02:13:27.492237 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.492131 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46rrn"] May 21 02:13:27.494529 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:27.494501 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e6e36f_938c_465f_8c2f_d8512bdc7148.slice/crio-436464a2c41488b9284aaca82687d50bccf22274f3d529786ca389dfabd1fbf2 WatchSource:0}: Error finding container 436464a2c41488b9284aaca82687d50bccf22274f3d529786ca389dfabd1fbf2: Status 404 returned error can't find the container with id 436464a2c41488b9284aaca82687d50bccf22274f3d529786ca389dfabd1fbf2 May 21 02:13:27.634875 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.634798 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrcxx"] May 21 02:13:27.639330 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.639313 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:27.644289 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.644260 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrcxx"] May 21 02:13:27.719313 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.719279 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llr7x\" (UniqueName: \"kubernetes.io/projected/50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9-kube-api-access-llr7x\") pod \"kuadrant-operator-catalog-zrcxx\" (UID: \"50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9\") " pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:27.820597 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.820564 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llr7x\" (UniqueName: \"kubernetes.io/projected/50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9-kube-api-access-llr7x\") pod \"kuadrant-operator-catalog-zrcxx\" (UID: \"50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9\") " pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:27.828798 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.828739 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llr7x\" (UniqueName: \"kubernetes.io/projected/50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9-kube-api-access-llr7x\") pod \"kuadrant-operator-catalog-zrcxx\" (UID: \"50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9\") " pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:27.950019 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:27.949937 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:28.115363 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:28.115338 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrcxx"] May 21 02:13:28.118770 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:28.118724 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a6fc21_2a06_4846_8ab7_49b4cc6b7fa9.slice/crio-d8241f0b3eb46e4aa7d9f73e310fc3aafbc7f1cc35c216fbd7b3839aec2bf69b WatchSource:0}: Error finding container d8241f0b3eb46e4aa7d9f73e310fc3aafbc7f1cc35c216fbd7b3839aec2bf69b: Status 404 returned error can't find the container with id d8241f0b3eb46e4aa7d9f73e310fc3aafbc7f1cc35c216fbd7b3839aec2bf69b May 21 02:13:28.391809 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:28.391774 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" event={"ID":"50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9","Type":"ContainerStarted","Data":"d8241f0b3eb46e4aa7d9f73e310fc3aafbc7f1cc35c216fbd7b3839aec2bf69b"} May 21 02:13:28.392991 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:28.392965 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" event={"ID":"92e6e36f-938c-465f-8c2f-d8512bdc7148","Type":"ContainerStarted","Data":"436464a2c41488b9284aaca82687d50bccf22274f3d529786ca389dfabd1fbf2"} May 21 02:13:30.402125 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.402083 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" event={"ID":"50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9","Type":"ContainerStarted","Data":"8ef6a5764835b75f627ad82a735ee85e7f1eef040b9123440ee588b1a3383e48"} May 21 02:13:30.403551 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.403524 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" event={"ID":"92e6e36f-938c-465f-8c2f-d8512bdc7148","Type":"ContainerStarted","Data":"6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905"} May 21 02:13:30.403667 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.403597 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" podUID="92e6e36f-938c-465f-8c2f-d8512bdc7148" containerName="registry-server" containerID="cri-o://6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905" gracePeriod=2 May 21 02:13:30.416547 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.416504 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" podStartSLOduration=1.82090203 podStartE2EDuration="3.416490658s" podCreationTimestamp="2026-05-21 02:13:27 +0000 UTC" firstStartedPulling="2026-05-21 02:13:28.12020227 +0000 UTC m=+461.883434633" lastFinishedPulling="2026-05-21 02:13:29.715790893 +0000 UTC m=+463.479023261" observedRunningTime="2026-05-21 02:13:30.415313356 +0000 UTC m=+464.178545742" watchObservedRunningTime="2026-05-21 02:13:30.416490658 +0000 UTC m=+464.179723041" May 21 02:13:30.429134 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.429088 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" podStartSLOduration=1.211763652 podStartE2EDuration="3.429064077s" podCreationTimestamp="2026-05-21 02:13:27 +0000 UTC" firstStartedPulling="2026-05-21 02:13:27.495717252 +0000 UTC m=+461.258949619" lastFinishedPulling="2026-05-21 02:13:29.713017678 +0000 UTC m=+463.476250044" observedRunningTime="2026-05-21 02:13:30.4281842 +0000 UTC m=+464.191416586" watchObservedRunningTime="2026-05-21 02:13:30.429064077 +0000 UTC m=+464.192296474" May 21 02:13:30.638915 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.638893 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:30.750111 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.750072 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zx5c\" (UniqueName: \"kubernetes.io/projected/92e6e36f-938c-465f-8c2f-d8512bdc7148-kube-api-access-2zx5c\") pod \"92e6e36f-938c-465f-8c2f-d8512bdc7148\" (UID: \"92e6e36f-938c-465f-8c2f-d8512bdc7148\") " May 21 02:13:30.752251 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.752229 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e6e36f-938c-465f-8c2f-d8512bdc7148-kube-api-access-2zx5c" (OuterVolumeSpecName: "kube-api-access-2zx5c") pod "92e6e36f-938c-465f-8c2f-d8512bdc7148" (UID: "92e6e36f-938c-465f-8c2f-d8512bdc7148"). InnerVolumeSpecName "kube-api-access-2zx5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:13:30.850988 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:30.850946 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zx5c\" (UniqueName: \"kubernetes.io/projected/92e6e36f-938c-465f-8c2f-d8512bdc7148-kube-api-access-2zx5c\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:31.407993 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.407956 2548 generic.go:358] "Generic (PLEG): container finished" podID="92e6e36f-938c-465f-8c2f-d8512bdc7148" containerID="6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905" exitCode=0 May 21 02:13:31.408423 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.408013 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" May 21 02:13:31.408423 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.408040 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" event={"ID":"92e6e36f-938c-465f-8c2f-d8512bdc7148","Type":"ContainerDied","Data":"6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905"} May 21 02:13:31.408423 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.408076 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46rrn" event={"ID":"92e6e36f-938c-465f-8c2f-d8512bdc7148","Type":"ContainerDied","Data":"436464a2c41488b9284aaca82687d50bccf22274f3d529786ca389dfabd1fbf2"} May 21 02:13:31.408423 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.408092 2548 scope.go:117] "RemoveContainer" containerID="6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905" May 21 02:13:31.416815 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.416799 2548 scope.go:117] "RemoveContainer" containerID="6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905" May 21 02:13:31.417064 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:13:31.417045 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905\": container with ID starting with 6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905 not found: ID does not exist" containerID="6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905" May 21 02:13:31.417130 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.417073 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905"} err="failed to get container status \"6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905\": rpc error: code = NotFound desc = could not find container \"6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905\": container with ID starting with 6f2086cd2ab486e462d5d3760afcf6ba5b63f74905c5350d12d0ca2e45815905 not found: ID does not exist" May 21 02:13:31.422985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.422964 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46rrn"] May 21 02:13:31.429206 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:31.429183 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46rrn"] May 21 02:13:32.854944 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:32.854911 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92e6e36f-938c-465f-8c2f-d8512bdc7148" path="/var/lib/kubelet/pods/92e6e36f-938c-465f-8c2f-d8512bdc7148/volumes" May 21 02:13:37.950819 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:37.950769 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:37.950819 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:37.950826 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:37.972347 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:37.972319 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:38.454575 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:38.454548 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zrcxx" May 21 02:13:42.195316 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.195283 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph"] May 21 02:13:42.195702 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.195626 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e6e36f-938c-465f-8c2f-d8512bdc7148" containerName="registry-server" May 21 02:13:42.195702 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.195637 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e6e36f-938c-465f-8c2f-d8512bdc7148" containerName="registry-server" May 21 02:13:42.195702 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.195698 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="92e6e36f-938c-465f-8c2f-d8512bdc7148" containerName="registry-server" May 21 02:13:42.198899 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.198875 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.201007 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.200989 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m872m\"" May 21 02:13:42.204675 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.204654 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph"] May 21 02:13:42.246833 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.246793 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.246833 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.246834 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mxgb\" (UniqueName: \"kubernetes.io/projected/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-kube-api-access-7mxgb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.247057 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.246871 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.347852 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.347814 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.347852 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.347854 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxgb\" (UniqueName: \"kubernetes.io/projected/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-kube-api-access-7mxgb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.348094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.347898 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.348282 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.348261 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.348282 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.348276 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.356318 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.356295 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mxgb\" (UniqueName: \"kubernetes.io/projected/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-kube-api-access-7mxgb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.509716 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.509684 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:42.596637 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.596604 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv"] May 21 02:13:42.602681 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.602658 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.608156 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.608128 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv"] May 21 02:13:42.644877 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.644849 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph"] May 21 02:13:42.646786 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:42.646759 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e8a110_b2be_43ca_bb00_ec469c3a1e3c.slice/crio-95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5 WatchSource:0}: Error finding container 95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5: Status 404 returned error can't find the container with id 95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5 May 21 02:13:42.751602 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.751571 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww8tk\" (UniqueName: \"kubernetes.io/projected/72853bc1-0e17-4eee-be1c-c5499d8afff5-kube-api-access-ww8tk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.751706 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.751656 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.751775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.751714 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.852327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.852254 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww8tk\" (UniqueName: \"kubernetes.io/projected/72853bc1-0e17-4eee-be1c-c5499d8afff5-kube-api-access-ww8tk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.852327 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.852300 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.852526 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.852486 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.852671 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.852653 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.852836 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.852818 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.859526 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.859502 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww8tk\" (UniqueName: \"kubernetes.io/projected/72853bc1-0e17-4eee-be1c-c5499d8afff5-kube-api-access-ww8tk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:42.917411 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:42.917367 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:43.046243 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.046180 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv"] May 21 02:13:43.048422 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:43.048396 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72853bc1_0e17_4eee_be1c_c5499d8afff5.slice/crio-0e836c2bc6aec317f2aaae2d3867327a85de36397288e554eb64747007011e69 WatchSource:0}: Error finding container 0e836c2bc6aec317f2aaae2d3867327a85de36397288e554eb64747007011e69: Status 404 returned error can't find the container with id 0e836c2bc6aec317f2aaae2d3867327a85de36397288e554eb64747007011e69 May 21 02:13:43.194154 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.194122 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb"] May 21 02:13:43.197651 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.197633 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.203537 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.203512 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb"] May 21 02:13:43.256455 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.256420 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.256637 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.256487 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp7wk\" (UniqueName: \"kubernetes.io/projected/a127a780-4870-448f-bff4-8a71ec228217-kube-api-access-fp7wk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.256637 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.256522 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.357973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.357892 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.358126 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.357981 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp7wk\" (UniqueName: \"kubernetes.io/projected/a127a780-4870-448f-bff4-8a71ec228217-kube-api-access-fp7wk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.358126 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.358009 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.358347 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.358327 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.358394 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.358360 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.367968 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.367947 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp7wk\" (UniqueName: \"kubernetes.io/projected/a127a780-4870-448f-bff4-8a71ec228217-kube-api-access-fp7wk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.453131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.453097 2548 generic.go:358] "Generic (PLEG): container finished" podID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerID="e81a91b4c3e89426348249a5f52b566743c9c6caaf95e598aed48281e2cfb6e1" exitCode=0 May 21 02:13:43.453303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.453177 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" event={"ID":"72853bc1-0e17-4eee-be1c-c5499d8afff5","Type":"ContainerDied","Data":"e81a91b4c3e89426348249a5f52b566743c9c6caaf95e598aed48281e2cfb6e1"} May 21 02:13:43.453303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.453210 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" event={"ID":"72853bc1-0e17-4eee-be1c-c5499d8afff5","Type":"ContainerStarted","Data":"0e836c2bc6aec317f2aaae2d3867327a85de36397288e554eb64747007011e69"} May 21 02:13:43.454730 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.454708 2548 generic.go:358] "Generic (PLEG): container finished" podID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerID="4a7c4b9ba8a73d77d0822545b628102e37c61e7ac1780bf2780497788ff9edf2" exitCode=0 May 21 02:13:43.454845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.454766 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" event={"ID":"80e8a110-b2be-43ca-bb00-ec469c3a1e3c","Type":"ContainerDied","Data":"4a7c4b9ba8a73d77d0822545b628102e37c61e7ac1780bf2780497788ff9edf2"} May 21 02:13:43.454845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.454789 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" event={"ID":"80e8a110-b2be-43ca-bb00-ec469c3a1e3c","Type":"ContainerStarted","Data":"95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5"} May 21 02:13:43.507842 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.507811 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:43.632958 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.632933 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb"] May 21 02:13:43.634714 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:43.634692 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda127a780_4870_448f_bff4_8a71ec228217.slice/crio-d11c969514ef2bb4b93fa0ca9625d3c45f8f55765b4566ea8a955058764eff1f WatchSource:0}: Error finding container d11c969514ef2bb4b93fa0ca9625d3c45f8f55765b4566ea8a955058764eff1f: Status 404 returned error can't find the container with id d11c969514ef2bb4b93fa0ca9625d3c45f8f55765b4566ea8a955058764eff1f May 21 02:13:43.799849 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.799817 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf"] May 21 02:13:43.803324 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.803308 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.809429 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.809392 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf"] May 21 02:13:43.863665 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.863637 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.863845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.863685 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95gb7\" (UniqueName: \"kubernetes.io/projected/b3862a22-0e6c-4139-a49d-89c01f227d51-kube-api-access-95gb7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.863845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.863783 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.964697 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.964608 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.964892 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.964716 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.964892 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.964785 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95gb7\" (UniqueName: \"kubernetes.io/projected/b3862a22-0e6c-4139-a49d-89c01f227d51-kube-api-access-95gb7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.965131 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.965106 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.965183 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.965165 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:43.972243 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:43.972223 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95gb7\" (UniqueName: \"kubernetes.io/projected/b3862a22-0e6c-4139-a49d-89c01f227d51-kube-api-access-95gb7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:44.114002 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.113947 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:44.303618 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.303590 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf"] May 21 02:13:44.307325 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:44.307299 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3862a22_0e6c_4139_a49d_89c01f227d51.slice/crio-9a8e3e6f2294fd121db8fb52455debec6ea4a854ba803c848deb6f6d76631932 WatchSource:0}: Error finding container 9a8e3e6f2294fd121db8fb52455debec6ea4a854ba803c848deb6f6d76631932: Status 404 returned error can't find the container with id 9a8e3e6f2294fd121db8fb52455debec6ea4a854ba803c848deb6f6d76631932 May 21 02:13:44.461646 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.461612 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" event={"ID":"b3862a22-0e6c-4139-a49d-89c01f227d51","Type":"ContainerStarted","Data":"65a33cbc86a76dda789607514879e7407c6558549170d19b0f42df63f6f9a634"} May 21 02:13:44.461832 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.461659 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" event={"ID":"b3862a22-0e6c-4139-a49d-89c01f227d51","Type":"ContainerStarted","Data":"9a8e3e6f2294fd121db8fb52455debec6ea4a854ba803c848deb6f6d76631932"} May 21 02:13:44.465551 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.465523 2548 generic.go:358] "Generic (PLEG): container finished" podID="a127a780-4870-448f-bff4-8a71ec228217" containerID="25697cf84e010f45458a49e988b3662d75cb705c212987eba1c78839692a2616" exitCode=0 May 21 02:13:44.465653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.465575 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" event={"ID":"a127a780-4870-448f-bff4-8a71ec228217","Type":"ContainerDied","Data":"25697cf84e010f45458a49e988b3662d75cb705c212987eba1c78839692a2616"} May 21 02:13:44.465653 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:44.465599 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" event={"ID":"a127a780-4870-448f-bff4-8a71ec228217","Type":"ContainerStarted","Data":"d11c969514ef2bb4b93fa0ca9625d3c45f8f55765b4566ea8a955058764eff1f"} May 21 02:13:45.473271 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.473233 2548 generic.go:358] "Generic (PLEG): container finished" podID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerID="9513779c7d67afde265b2d1f0243251664f593c46e199b24810f4591b3201f24" exitCode=0 May 21 02:13:45.473670 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.473314 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" event={"ID":"80e8a110-b2be-43ca-bb00-ec469c3a1e3c","Type":"ContainerDied","Data":"9513779c7d67afde265b2d1f0243251664f593c46e199b24810f4591b3201f24"} May 21 02:13:45.474967 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.474945 2548 generic.go:358] "Generic (PLEG): container finished" podID="a127a780-4870-448f-bff4-8a71ec228217" containerID="e94dd4a63afbc6809cc30086bae77fa41893f1ba53d982828199768cb95a7e20" exitCode=0 May 21 02:13:45.475081 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.475026 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" event={"ID":"a127a780-4870-448f-bff4-8a71ec228217","Type":"ContainerDied","Data":"e94dd4a63afbc6809cc30086bae77fa41893f1ba53d982828199768cb95a7e20"} May 21 02:13:45.476334 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.476315 2548 generic.go:358] "Generic (PLEG): container finished" podID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerID="65a33cbc86a76dda789607514879e7407c6558549170d19b0f42df63f6f9a634" exitCode=0 May 21 02:13:45.476569 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.476436 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" event={"ID":"b3862a22-0e6c-4139-a49d-89c01f227d51","Type":"ContainerDied","Data":"65a33cbc86a76dda789607514879e7407c6558549170d19b0f42df63f6f9a634"} May 21 02:13:45.478116 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.478099 2548 generic.go:358] "Generic (PLEG): container finished" podID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerID="524baabf496f12559368b382edf99a7bba53cd921d930ba20674d5d8186ef9e3" exitCode=0 May 21 02:13:45.478193 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:45.478156 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" event={"ID":"72853bc1-0e17-4eee-be1c-c5499d8afff5","Type":"ContainerDied","Data":"524baabf496f12559368b382edf99a7bba53cd921d930ba20674d5d8186ef9e3"} May 21 02:13:46.484141 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.484109 2548 generic.go:358] "Generic (PLEG): container finished" podID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerID="f7e775226f6300e28f4a97f785e80e51001457df94d9cc3e149092214c337ab8" exitCode=0 May 21 02:13:46.484558 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.484196 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" event={"ID":"80e8a110-b2be-43ca-bb00-ec469c3a1e3c","Type":"ContainerDied","Data":"f7e775226f6300e28f4a97f785e80e51001457df94d9cc3e149092214c337ab8"} May 21 02:13:46.486038 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.486016 2548 generic.go:358] "Generic (PLEG): container finished" podID="a127a780-4870-448f-bff4-8a71ec228217" containerID="e3f8e45339014b600f41f3460e50385724249a56653b4dc298e31e4d90a0c2aa" exitCode=0 May 21 02:13:46.486148 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.486094 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" event={"ID":"a127a780-4870-448f-bff4-8a71ec228217","Type":"ContainerDied","Data":"e3f8e45339014b600f41f3460e50385724249a56653b4dc298e31e4d90a0c2aa"} May 21 02:13:46.487552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.487493 2548 generic.go:358] "Generic (PLEG): container finished" podID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerID="8ee00b95d0658a5ba00f5f2f1b4e880721529538470e89cbffc069ddb3dbcfad" exitCode=0 May 21 02:13:46.487552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.487523 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" event={"ID":"b3862a22-0e6c-4139-a49d-89c01f227d51","Type":"ContainerDied","Data":"8ee00b95d0658a5ba00f5f2f1b4e880721529538470e89cbffc069ddb3dbcfad"} May 21 02:13:46.489506 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.489486 2548 generic.go:358] "Generic (PLEG): container finished" podID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerID="89cb989e015f3582944179747056b8bccd5fec5df863d73ea935c2a51369d152" exitCode=0 May 21 02:13:46.489582 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:46.489549 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" event={"ID":"72853bc1-0e17-4eee-be1c-c5499d8afff5","Type":"ContainerDied","Data":"89cb989e015f3582944179747056b8bccd5fec5df863d73ea935c2a51369d152"} May 21 02:13:47.495194 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.495154 2548 generic.go:358] "Generic (PLEG): container finished" podID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerID="883dbd2bc6e9dcfa4a6ac8db63ee821b386d3d0839c161c4a4dab6e97fc4d3ea" exitCode=0 May 21 02:13:47.495611 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.495241 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" event={"ID":"b3862a22-0e6c-4139-a49d-89c01f227d51","Type":"ContainerDied","Data":"883dbd2bc6e9dcfa4a6ac8db63ee821b386d3d0839c161c4a4dab6e97fc4d3ea"} May 21 02:13:47.635873 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.635847 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:47.678617 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.678593 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:47.681864 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.681839 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:47.699387 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.699359 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-bundle\") pod \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " May 21 02:13:47.699538 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.699429 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-util\") pod \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " May 21 02:13:47.699538 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.699519 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mxgb\" (UniqueName: \"kubernetes.io/projected/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-kube-api-access-7mxgb\") pod \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\" (UID: \"80e8a110-b2be-43ca-bb00-ec469c3a1e3c\") " May 21 02:13:47.699961 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.699933 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-bundle" (OuterVolumeSpecName: "bundle") pod "80e8a110-b2be-43ca-bb00-ec469c3a1e3c" (UID: "80e8a110-b2be-43ca-bb00-ec469c3a1e3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:47.701649 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.701628 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-kube-api-access-7mxgb" (OuterVolumeSpecName: "kube-api-access-7mxgb") pod "80e8a110-b2be-43ca-bb00-ec469c3a1e3c" (UID: "80e8a110-b2be-43ca-bb00-ec469c3a1e3c"). InnerVolumeSpecName "kube-api-access-7mxgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:13:47.708320 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.708275 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-util" (OuterVolumeSpecName: "util") pod "80e8a110-b2be-43ca-bb00-ec469c3a1e3c" (UID: "80e8a110-b2be-43ca-bb00-ec469c3a1e3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:47.800777 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.800662 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-util\") pod \"a127a780-4870-448f-bff4-8a71ec228217\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " May 21 02:13:47.800777 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.800786 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-bundle\") pod \"a127a780-4870-448f-bff4-8a71ec228217\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " May 21 02:13:47.801001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.800811 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-util\") pod \"72853bc1-0e17-4eee-be1c-c5499d8afff5\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " May 21 02:13:47.801001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.800851 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww8tk\" (UniqueName: \"kubernetes.io/projected/72853bc1-0e17-4eee-be1c-c5499d8afff5-kube-api-access-ww8tk\") pod \"72853bc1-0e17-4eee-be1c-c5499d8afff5\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " May 21 02:13:47.801001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.800867 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp7wk\" (UniqueName: \"kubernetes.io/projected/a127a780-4870-448f-bff4-8a71ec228217-kube-api-access-fp7wk\") pod \"a127a780-4870-448f-bff4-8a71ec228217\" (UID: \"a127a780-4870-448f-bff4-8a71ec228217\") " May 21 02:13:47.801001 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.800908 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-bundle\") pod \"72853bc1-0e17-4eee-be1c-c5499d8afff5\" (UID: \"72853bc1-0e17-4eee-be1c-c5499d8afff5\") " May 21 02:13:47.801226 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.801077 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.801226 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.801108 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.801226 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.801122 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mxgb\" (UniqueName: \"kubernetes.io/projected/80e8a110-b2be-43ca-bb00-ec469c3a1e3c-kube-api-access-7mxgb\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.801643 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.801587 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-bundle" (OuterVolumeSpecName: "bundle") pod "a127a780-4870-448f-bff4-8a71ec228217" (UID: "a127a780-4870-448f-bff4-8a71ec228217"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:47.801766 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.801652 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-bundle" (OuterVolumeSpecName: "bundle") pod "72853bc1-0e17-4eee-be1c-c5499d8afff5" (UID: "72853bc1-0e17-4eee-be1c-c5499d8afff5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:47.803050 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.803024 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a127a780-4870-448f-bff4-8a71ec228217-kube-api-access-fp7wk" (OuterVolumeSpecName: "kube-api-access-fp7wk") pod "a127a780-4870-448f-bff4-8a71ec228217" (UID: "a127a780-4870-448f-bff4-8a71ec228217"). InnerVolumeSpecName "kube-api-access-fp7wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:13:47.803144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.803090 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72853bc1-0e17-4eee-be1c-c5499d8afff5-kube-api-access-ww8tk" (OuterVolumeSpecName: "kube-api-access-ww8tk") pod "72853bc1-0e17-4eee-be1c-c5499d8afff5" (UID: "72853bc1-0e17-4eee-be1c-c5499d8afff5"). InnerVolumeSpecName "kube-api-access-ww8tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:13:47.805869 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.805839 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-util" (OuterVolumeSpecName: "util") pod "a127a780-4870-448f-bff4-8a71ec228217" (UID: "a127a780-4870-448f-bff4-8a71ec228217"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:47.806824 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.806805 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-util" (OuterVolumeSpecName: "util") pod "72853bc1-0e17-4eee-be1c-c5499d8afff5" (UID: "72853bc1-0e17-4eee-be1c-c5499d8afff5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:47.901862 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.901812 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.901862 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.901857 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a127a780-4870-448f-bff4-8a71ec228217-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.901862 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.901866 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.901862 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.901876 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww8tk\" (UniqueName: \"kubernetes.io/projected/72853bc1-0e17-4eee-be1c-c5499d8afff5-kube-api-access-ww8tk\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.902129 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.901886 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp7wk\" (UniqueName: \"kubernetes.io/projected/a127a780-4870-448f-bff4-8a71ec228217-kube-api-access-fp7wk\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:47.902129 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:47.901896 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72853bc1-0e17-4eee-be1c-c5499d8afff5-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:48.501044 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.501007 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" May 21 02:13:48.501044 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.501021 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv" event={"ID":"72853bc1-0e17-4eee-be1c-c5499d8afff5","Type":"ContainerDied","Data":"0e836c2bc6aec317f2aaae2d3867327a85de36397288e554eb64747007011e69"} May 21 02:13:48.501044 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.501049 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e836c2bc6aec317f2aaae2d3867327a85de36397288e554eb64747007011e69" May 21 02:13:48.502707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.502683 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" event={"ID":"80e8a110-b2be-43ca-bb00-ec469c3a1e3c","Type":"ContainerDied","Data":"95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5"} May 21 02:13:48.502843 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.502716 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5" May 21 02:13:48.502843 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.502687 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph" May 21 02:13:48.504444 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.504418 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" event={"ID":"a127a780-4870-448f-bff4-8a71ec228217","Type":"ContainerDied","Data":"d11c969514ef2bb4b93fa0ca9625d3c45f8f55765b4566ea8a955058764eff1f"} May 21 02:13:48.504444 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.504447 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d11c969514ef2bb4b93fa0ca9625d3c45f8f55765b4566ea8a955058764eff1f" May 21 02:13:48.504585 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.504448 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb" May 21 02:13:48.514443 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:13:48.514397 2548 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e8a110_b2be_43ca_bb00_ec469c3a1e3c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e8a110_b2be_43ca_bb00_ec469c3a1e3c.slice/crio-95b17e2c8ec5904aaa9c3b7f0e7ebfb9e72a4f618c0edd6c29a87eed53defcc5\": RecentStats: unable to find data in memory cache]" May 21 02:13:48.639015 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.638994 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:48.710103 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.710063 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95gb7\" (UniqueName: \"kubernetes.io/projected/b3862a22-0e6c-4139-a49d-89c01f227d51-kube-api-access-95gb7\") pod \"b3862a22-0e6c-4139-a49d-89c01f227d51\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " May 21 02:13:48.710299 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.710160 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-util\") pod \"b3862a22-0e6c-4139-a49d-89c01f227d51\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " May 21 02:13:48.710299 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.710200 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-bundle\") pod \"b3862a22-0e6c-4139-a49d-89c01f227d51\" (UID: \"b3862a22-0e6c-4139-a49d-89c01f227d51\") " May 21 02:13:48.710684 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.710660 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-bundle" (OuterVolumeSpecName: "bundle") pod "b3862a22-0e6c-4139-a49d-89c01f227d51" (UID: "b3862a22-0e6c-4139-a49d-89c01f227d51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:48.712934 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.712896 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3862a22-0e6c-4139-a49d-89c01f227d51-kube-api-access-95gb7" (OuterVolumeSpecName: "kube-api-access-95gb7") pod "b3862a22-0e6c-4139-a49d-89c01f227d51" (UID: "b3862a22-0e6c-4139-a49d-89c01f227d51"). InnerVolumeSpecName "kube-api-access-95gb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:13:48.717654 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.717627 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-util" (OuterVolumeSpecName: "util") pod "b3862a22-0e6c-4139-a49d-89c01f227d51" (UID: "b3862a22-0e6c-4139-a49d-89c01f227d51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 02:13:48.811293 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.811197 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95gb7\" (UniqueName: \"kubernetes.io/projected/b3862a22-0e6c-4139-a49d-89c01f227d51-kube-api-access-95gb7\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:48.811293 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.811233 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-util\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:48.811293 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:48.811247 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3862a22-0e6c-4139-a49d-89c01f227d51-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:13:49.509442 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:49.509415 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" May 21 02:13:49.509843 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:49.509413 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf" event={"ID":"b3862a22-0e6c-4139-a49d-89c01f227d51","Type":"ContainerDied","Data":"9a8e3e6f2294fd121db8fb52455debec6ea4a854ba803c848deb6f6d76631932"} May 21 02:13:49.509843 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:49.509522 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a8e3e6f2294fd121db8fb52455debec6ea4a854ba803c848deb6f6d76631932" May 21 02:13:59.250293 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250255 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-j6zmw"] May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250629 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250641 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250649 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="extract" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250655 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="extract" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250668 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250674 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250683 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="extract" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250692 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="extract" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250705 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250710 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250716 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250721 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="pull" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250729 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="util" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250733 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="util" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250739 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="util" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250756 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="util" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250765 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="util" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250773 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="util" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250780 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="extract" May 21 02:13:59.250775 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250786 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="extract" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250795 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="util" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250800 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="util" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250806 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="extract" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250811 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="extract" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250885 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3862a22-0e6c-4139-a49d-89c01f227d51" containerName="extract" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250893 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="80e8a110-b2be-43ca-bb00-ec469c3a1e3c" containerName="extract" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250899 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="a127a780-4870-448f-bff4-8a71ec228217" containerName="extract" May 21 02:13:59.251359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.250907 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="72853bc1-0e17-4eee-be1c-c5499d8afff5" containerName="extract" May 21 02:13:59.262916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.262887 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:13:59.263351 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.263318 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-j6zmw"] May 21 02:13:59.265486 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.265462 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xjvpr\"" May 21 02:13:59.405808 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.405771 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcl7s\" (UniqueName: \"kubernetes.io/projected/ad59926e-7cba-4d01-ae03-4ed0726bb0dc-kube-api-access-bcl7s\") pod \"authorino-operator-657f44b778-j6zmw\" (UID: \"ad59926e-7cba-4d01-ae03-4ed0726bb0dc\") " pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:13:59.507213 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.507111 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcl7s\" (UniqueName: \"kubernetes.io/projected/ad59926e-7cba-4d01-ae03-4ed0726bb0dc-kube-api-access-bcl7s\") pod \"authorino-operator-657f44b778-j6zmw\" (UID: \"ad59926e-7cba-4d01-ae03-4ed0726bb0dc\") " pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:13:59.514858 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.514830 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcl7s\" (UniqueName: \"kubernetes.io/projected/ad59926e-7cba-4d01-ae03-4ed0726bb0dc-kube-api-access-bcl7s\") pod \"authorino-operator-657f44b778-j6zmw\" (UID: \"ad59926e-7cba-4d01-ae03-4ed0726bb0dc\") " pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:13:59.573877 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.573851 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:13:59.700777 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:13:59.700734 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-j6zmw"] May 21 02:13:59.702148 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:13:59.702123 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad59926e_7cba_4d01_ae03_4ed0726bb0dc.slice/crio-7da7220be71a5bd43dac747e77b8766ef091055882ef3fcd2229bc4c3de3fade WatchSource:0}: Error finding container 7da7220be71a5bd43dac747e77b8766ef091055882ef3fcd2229bc4c3de3fade: Status 404 returned error can't find the container with id 7da7220be71a5bd43dac747e77b8766ef091055882ef3fcd2229bc4c3de3fade May 21 02:14:00.550600 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:00.550566 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" event={"ID":"ad59926e-7cba-4d01-ae03-4ed0726bb0dc","Type":"ContainerStarted","Data":"7da7220be71a5bd43dac747e77b8766ef091055882ef3fcd2229bc4c3de3fade"} May 21 02:14:02.559632 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:02.559590 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" event={"ID":"ad59926e-7cba-4d01-ae03-4ed0726bb0dc","Type":"ContainerStarted","Data":"c2e547676bfe5a6a9639099ffc6e757f926124b0e31c8852d7a65c564ef49db2"} May 21 02:14:02.560079 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:02.559724 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:14:02.583267 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:02.583207 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" podStartSLOduration=1.4203748950000001 podStartE2EDuration="3.58319002s" podCreationTimestamp="2026-05-21 02:13:59 +0000 UTC" firstStartedPulling="2026-05-21 02:13:59.704070264 +0000 UTC m=+493.467302628" lastFinishedPulling="2026-05-21 02:14:01.866885387 +0000 UTC m=+495.630117753" observedRunningTime="2026-05-21 02:14:02.579903918 +0000 UTC m=+496.343136303" watchObservedRunningTime="2026-05-21 02:14:02.58319002 +0000 UTC m=+496.346422405" May 21 02:14:07.183946 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.183907 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q"] May 21 02:14:07.186376 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.186353 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:07.189099 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.189070 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 02:14:07.189185 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.189097 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qknm5\"" May 21 02:14:07.194698 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.194676 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q"] May 21 02:14:07.275191 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.275159 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv2kj\" (UniqueName: \"kubernetes.io/projected/0c317b68-fb74-4163-b9a6-67ea24d7945f-kube-api-access-rv2kj\") pod \"dns-operator-controller-manager-648d5c98bc-wzt2q\" (UID: \"0c317b68-fb74-4163-b9a6-67ea24d7945f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:07.375625 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.375586 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv2kj\" (UniqueName: \"kubernetes.io/projected/0c317b68-fb74-4163-b9a6-67ea24d7945f-kube-api-access-rv2kj\") pod \"dns-operator-controller-manager-648d5c98bc-wzt2q\" (UID: \"0c317b68-fb74-4163-b9a6-67ea24d7945f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:07.386203 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.386169 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv2kj\" (UniqueName: \"kubernetes.io/projected/0c317b68-fb74-4163-b9a6-67ea24d7945f-kube-api-access-rv2kj\") pod \"dns-operator-controller-manager-648d5c98bc-wzt2q\" (UID: \"0c317b68-fb74-4163-b9a6-67ea24d7945f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:07.497435 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.497404 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:07.643727 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:07.643703 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q"] May 21 02:14:07.646430 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:07.646401 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c317b68_fb74_4163_b9a6_67ea24d7945f.slice/crio-63d7421428d1c729e0dcd293f32a8209db72aae42873b181100eb01daa6fd1b8 WatchSource:0}: Error finding container 63d7421428d1c729e0dcd293f32a8209db72aae42873b181100eb01daa6fd1b8: Status 404 returned error can't find the container with id 63d7421428d1c729e0dcd293f32a8209db72aae42873b181100eb01daa6fd1b8 May 21 02:14:08.588044 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:08.588009 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" event={"ID":"0c317b68-fb74-4163-b9a6-67ea24d7945f","Type":"ContainerStarted","Data":"63d7421428d1c729e0dcd293f32a8209db72aae42873b181100eb01daa6fd1b8"} May 21 02:14:09.801763 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:09.801719 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb"] May 21 02:14:09.805561 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:09.805533 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:09.808051 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:09.808028 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7mjcr\"" May 21 02:14:09.813287 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:09.813262 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb"] May 21 02:14:09.898532 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:09.898487 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53-kube-api-access-s5h96\") pod \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" (UID: \"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:10.000106 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.000078 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53-kube-api-access-s5h96\") pod \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" (UID: \"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:10.008136 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.008098 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53-kube-api-access-s5h96\") pod \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" (UID: \"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:10.120283 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.120244 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:10.256807 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.256782 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb"] May 21 02:14:10.258695 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:10.258663 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e4cfb9_9080_4e9a_8d82_3b93b2a32e53.slice/crio-dfdbf2d41001af12c2ec2f8b4b63d902d049acf76706c2c045272fe6fba0d360 WatchSource:0}: Error finding container dfdbf2d41001af12c2ec2f8b4b63d902d049acf76706c2c045272fe6fba0d360: Status 404 returned error can't find the container with id dfdbf2d41001af12c2ec2f8b4b63d902d049acf76706c2c045272fe6fba0d360 May 21 02:14:10.597511 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.597476 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" event={"ID":"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53","Type":"ContainerStarted","Data":"dfdbf2d41001af12c2ec2f8b4b63d902d049acf76706c2c045272fe6fba0d360"} May 21 02:14:10.598928 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.598901 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" event={"ID":"0c317b68-fb74-4163-b9a6-67ea24d7945f","Type":"ContainerStarted","Data":"851fcc1f5336ea79fa34a9c96a98948b72bd92090be604f024f1263472dd05d5"} May 21 02:14:10.599059 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.598950 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:10.620250 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:10.620204 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" podStartSLOduration=1.26744805 podStartE2EDuration="3.620189443s" podCreationTimestamp="2026-05-21 02:14:07 +0000 UTC" firstStartedPulling="2026-05-21 02:14:07.648357912 +0000 UTC m=+501.411590274" lastFinishedPulling="2026-05-21 02:14:10.001099304 +0000 UTC m=+503.764331667" observedRunningTime="2026-05-21 02:14:10.617795484 +0000 UTC m=+504.381027869" watchObservedRunningTime="2026-05-21 02:14:10.620189443 +0000 UTC m=+504.383421827" May 21 02:14:12.609023 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:12.608981 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" event={"ID":"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53","Type":"ContainerStarted","Data":"766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc"} May 21 02:14:12.609498 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:12.609077 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:12.627625 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:12.627574 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" podStartSLOduration=1.888744846 podStartE2EDuration="3.627561266s" podCreationTimestamp="2026-05-21 02:14:09 +0000 UTC" firstStartedPulling="2026-05-21 02:14:10.260595684 +0000 UTC m=+504.023828050" lastFinishedPulling="2026-05-21 02:14:11.9994121 +0000 UTC m=+505.762644470" observedRunningTime="2026-05-21 02:14:12.626926343 +0000 UTC m=+506.390158730" watchObservedRunningTime="2026-05-21 02:14:12.627561266 +0000 UTC m=+506.390793673" May 21 02:14:13.566580 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:13.566545 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-j6zmw" May 21 02:14:21.605815 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:21.605785 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wzt2q" May 21 02:14:23.365922 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.365889 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb"] May 21 02:14:23.366375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.366171 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" containerName="manager" containerID="cri-o://766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc" gracePeriod=2 May 21 02:14:23.367790 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.367762 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:23.373340 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.373297 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb"] May 21 02:14:23.376926 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.376895 2548 status_manager.go:895] "Failed to get status for pod" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" err="pods \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" is forbidden: User \"system:node:ip-10-0-139-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-23.ec2.internal' and this object" May 21 02:14:23.390765 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.390717 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr"] May 21 02:14:23.391229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.391209 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" containerName="manager" May 21 02:14:23.391229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.391228 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" containerName="manager" May 21 02:14:23.391386 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.391309 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" containerName="manager" May 21 02:14:23.394504 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.394486 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:23.397480 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.397454 2548 status_manager.go:895] "Failed to get status for pod" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" err="pods \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" is forbidden: User \"system:node:ip-10-0-139-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-23.ec2.internal' and this object" May 21 02:14:23.406070 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.406046 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr"] May 21 02:14:23.524529 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.524498 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gld2h\" (UniqueName: \"kubernetes.io/projected/ca732611-66b0-4eba-9922-a210e49bc384-kube-api-access-gld2h\") pod \"limitador-operator-controller-manager-85c4996f8c-56dcr\" (UID: \"ca732611-66b0-4eba-9922-a210e49bc384\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:23.603306 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.603283 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:23.605488 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.605460 2548 status_manager.go:895] "Failed to get status for pod" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" err="pods \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" is forbidden: User \"system:node:ip-10-0-139-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-23.ec2.internal' and this object" May 21 02:14:23.625973 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.625912 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gld2h\" (UniqueName: \"kubernetes.io/projected/ca732611-66b0-4eba-9922-a210e49bc384-kube-api-access-gld2h\") pod \"limitador-operator-controller-manager-85c4996f8c-56dcr\" (UID: \"ca732611-66b0-4eba-9922-a210e49bc384\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:23.633805 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.633777 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gld2h\" (UniqueName: \"kubernetes.io/projected/ca732611-66b0-4eba-9922-a210e49bc384-kube-api-access-gld2h\") pod \"limitador-operator-controller-manager-85c4996f8c-56dcr\" (UID: \"ca732611-66b0-4eba-9922-a210e49bc384\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:23.658894 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.658866 2548 generic.go:358] "Generic (PLEG): container finished" podID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" containerID="766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc" exitCode=0 May 21 02:14:23.659030 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.658908 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" May 21 02:14:23.659030 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.658965 2548 scope.go:117] "RemoveContainer" containerID="766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc" May 21 02:14:23.661149 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.661127 2548 status_manager.go:895] "Failed to get status for pod" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" err="pods \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" is forbidden: User \"system:node:ip-10-0-139-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-23.ec2.internal' and this object" May 21 02:14:23.667280 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.667265 2548 scope.go:117] "RemoveContainer" containerID="766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc" May 21 02:14:23.667555 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:14:23.667537 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc\": container with ID starting with 766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc not found: ID does not exist" containerID="766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc" May 21 02:14:23.667593 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.667568 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc"} err="failed to get container status \"766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc\": rpc error: code = NotFound desc = could not find container \"766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc\": container with ID starting with 766744c038998f70db21d49e44985c629c7dfa3405dbef89e2d8c2c6c64c3efc not found: ID does not exist" May 21 02:14:23.727220 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.727190 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53-kube-api-access-s5h96\") pod \"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53\" (UID: \"a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53\") " May 21 02:14:23.729205 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.729184 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53-kube-api-access-s5h96" (OuterVolumeSpecName: "kube-api-access-s5h96") pod "a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" (UID: "a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53"). InnerVolumeSpecName "kube-api-access-s5h96". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:14:23.750375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.750348 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:23.828595 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.828565 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53-kube-api-access-s5h96\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:14:23.878881 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.878852 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr"] May 21 02:14:23.880290 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:23.880258 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca732611_66b0_4eba_9922_a210e49bc384.slice/crio-4004bd3f59059a8d5d1ef7db10c838ae7064c62cc06464a0e59f8a5369f39e2d WatchSource:0}: Error finding container 4004bd3f59059a8d5d1ef7db10c838ae7064c62cc06464a0e59f8a5369f39e2d: Status 404 returned error can't find the container with id 4004bd3f59059a8d5d1ef7db10c838ae7064c62cc06464a0e59f8a5369f39e2d May 21 02:14:23.974884 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:23.974855 2548 status_manager.go:895] "Failed to get status for pod" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" err="pods \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" is forbidden: User \"system:node:ip-10-0-139-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-23.ec2.internal' and this object" May 21 02:14:24.664686 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:24.664652 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" event={"ID":"ca732611-66b0-4eba-9922-a210e49bc384","Type":"ContainerStarted","Data":"ce755f64617d88b325f7046b3886314f1835b023112dadcc4da192ee080cb5c8"} May 21 02:14:24.664686 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:24.664686 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" event={"ID":"ca732611-66b0-4eba-9922-a210e49bc384","Type":"ContainerStarted","Data":"4004bd3f59059a8d5d1ef7db10c838ae7064c62cc06464a0e59f8a5369f39e2d"} May 21 02:14:24.665142 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:24.664811 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:24.666922 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:24.666897 2548 status_manager.go:895] "Failed to get status for pod" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4pjtb" err="pods \"limitador-operator-controller-manager-85c4996f8c-4pjtb\" is forbidden: User \"system:node:ip-10-0-139-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-23.ec2.internal' and this object" May 21 02:14:24.685234 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:24.685185 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" podStartSLOduration=1.6851716890000001 podStartE2EDuration="1.685171689s" podCreationTimestamp="2026-05-21 02:14:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:14:24.683350019 +0000 UTC m=+518.446582406" watchObservedRunningTime="2026-05-21 02:14:24.685171689 +0000 UTC m=+518.448404152" May 21 02:14:24.858634 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:24.858601 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53" path="/var/lib/kubelet/pods/a6e4cfb9-9080-4e9a-8d82-3b93b2a32e53/volumes" May 21 02:14:35.684100 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:35.684010 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-56dcr" May 21 02:14:51.940891 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:51.940859 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw"] May 21 02:14:51.948315 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:51.948287 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:51.950928 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:51.950903 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kb9pl\"" May 21 02:14:51.957336 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:51.957304 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw"] May 21 02:14:52.075378 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075340 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075388 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd448442-20c7-4484-b922-4d68ce05f473-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075406 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd448442-20c7-4484-b922-4d68ce05f473-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075511 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdfpl\" (UniqueName: \"kubernetes.io/projected/dd448442-20c7-4484-b922-4d68ce05f473-kube-api-access-zdfpl\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075560 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075538 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075824 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075824 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075605 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd448442-20c7-4484-b922-4d68ce05f473-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.075824 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.075629 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.176939 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.176898 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd448442-20c7-4484-b922-4d68ce05f473-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.176939 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.176948 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.176978 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177005 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd448442-20c7-4484-b922-4d68ce05f473-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177021 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177048 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd448442-20c7-4484-b922-4d68ce05f473-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177082 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdfpl\" (UniqueName: \"kubernetes.io/projected/dd448442-20c7-4484-b922-4d68ce05f473-kube-api-access-zdfpl\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177130 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177229 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177191 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177566 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177535 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177610 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177579 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177655 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177624 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.177803 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.177788 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.178030 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.178005 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd448442-20c7-4484-b922-4d68ce05f473-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.179324 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.179305 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd448442-20c7-4484-b922-4d68ce05f473-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.179452 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.179435 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd448442-20c7-4484-b922-4d68ce05f473-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.191359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.191293 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdfpl\" (UniqueName: \"kubernetes.io/projected/dd448442-20c7-4484-b922-4d68ce05f473-kube-api-access-zdfpl\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.194233 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.194212 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd448442-20c7-4484-b922-4d68ce05f473-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hpnjw\" (UID: \"dd448442-20c7-4484-b922-4d68ce05f473\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.260772 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.260718 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:52.394430 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.394404 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw"] May 21 02:14:52.397015 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:52.396990 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd448442_20c7_4484_b922_4d68ce05f473.slice/crio-54e4784999abc061d8f49452e7c46dc4db3f910d20617950ea5aa19c5964c59f WatchSource:0}: Error finding container 54e4784999abc061d8f49452e7c46dc4db3f910d20617950ea5aa19c5964c59f: Status 404 returned error can't find the container with id 54e4784999abc061d8f49452e7c46dc4db3f910d20617950ea5aa19c5964c59f May 21 02:14:52.399456 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.399423 2548 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 02:14:52.399538 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.399491 2548 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 02:14:52.399538 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.399520 2548 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 02:14:52.776021 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.775984 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" event={"ID":"dd448442-20c7-4484-b922-4d68ce05f473","Type":"ContainerStarted","Data":"74a479f1d88328ecc4297573bd60d78e54364629da14f1a59c24279e4ddd940d"} May 21 02:14:52.776198 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.776025 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" event={"ID":"dd448442-20c7-4484-b922-4d68ce05f473","Type":"ContainerStarted","Data":"54e4784999abc061d8f49452e7c46dc4db3f910d20617950ea5aa19c5964c59f"} May 21 02:14:52.793959 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:52.793893 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" podStartSLOduration=1.793879937 podStartE2EDuration="1.793879937s" podCreationTimestamp="2026-05-21 02:14:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:14:52.79298829 +0000 UTC m=+546.556220710" watchObservedRunningTime="2026-05-21 02:14:52.793879937 +0000 UTC m=+546.557112322" May 21 02:14:53.261518 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:53.261482 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:53.266436 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:53.266412 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:53.779665 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:53.779635 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:53.780733 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:53.780712 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hpnjw" May 21 02:14:56.758646 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.758610 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-52pzf"] May 21 02:14:56.762195 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.762161 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:14:56.764270 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.764255 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pl44d\"" May 21 02:14:56.769563 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.769540 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-52pzf"] May 21 02:14:56.816386 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.816358 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg6xf\" (UniqueName: \"kubernetes.io/projected/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c-kube-api-access-cg6xf\") pod \"authorino-f99f4b5cd-52pzf\" (UID: \"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c\") " pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:14:56.917691 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.917652 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg6xf\" (UniqueName: \"kubernetes.io/projected/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c-kube-api-access-cg6xf\") pod \"authorino-f99f4b5cd-52pzf\" (UID: \"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c\") " pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:14:56.925943 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.925924 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg6xf\" (UniqueName: \"kubernetes.io/projected/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c-kube-api-access-cg6xf\") pod \"authorino-f99f4b5cd-52pzf\" (UID: \"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c\") " pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:14:56.952585 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.952551 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-zf9gv"] May 21 02:14:56.956037 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.956022 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:14:56.961385 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:56.961362 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zf9gv"] May 21 02:14:57.019050 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.018974 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7mc\" (UniqueName: \"kubernetes.io/projected/7d77cec2-0f81-4ef3-899e-37cd34ccf281-kube-api-access-qz7mc\") pod \"authorino-7498df8756-zf9gv\" (UID: \"7d77cec2-0f81-4ef3-899e-37cd34ccf281\") " pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:14:57.072728 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.072695 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:14:57.120287 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.120140 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7mc\" (UniqueName: \"kubernetes.io/projected/7d77cec2-0f81-4ef3-899e-37cd34ccf281-kube-api-access-qz7mc\") pod \"authorino-7498df8756-zf9gv\" (UID: \"7d77cec2-0f81-4ef3-899e-37cd34ccf281\") " pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:14:57.128648 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.128592 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7mc\" (UniqueName: \"kubernetes.io/projected/7d77cec2-0f81-4ef3-899e-37cd34ccf281-kube-api-access-qz7mc\") pod \"authorino-7498df8756-zf9gv\" (UID: \"7d77cec2-0f81-4ef3-899e-37cd34ccf281\") " pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:14:57.204016 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.203991 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-52pzf"] May 21 02:14:57.206093 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:57.206067 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedc8c7a8_ae8a_4ea7_9f55_d2680a53487c.slice/crio-99687f8146d4722d0ad3af4f1b64dcd26a1766157e419a45167490cfc4f7dd68 WatchSource:0}: Error finding container 99687f8146d4722d0ad3af4f1b64dcd26a1766157e419a45167490cfc4f7dd68: Status 404 returned error can't find the container with id 99687f8146d4722d0ad3af4f1b64dcd26a1766157e419a45167490cfc4f7dd68 May 21 02:14:57.266065 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.266033 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:14:57.398461 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.398436 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zf9gv"] May 21 02:14:57.400345 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:57.400318 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d77cec2_0f81_4ef3_899e_37cd34ccf281.slice/crio-f457c1fa8868c9825f3c3fdb184fefc831b49b4d0524c0593ba00840cb22af73 WatchSource:0}: Error finding container f457c1fa8868c9825f3c3fdb184fefc831b49b4d0524c0593ba00840cb22af73: Status 404 returned error can't find the container with id f457c1fa8868c9825f3c3fdb184fefc831b49b4d0524c0593ba00840cb22af73 May 21 02:14:57.798034 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.798001 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" event={"ID":"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c","Type":"ContainerStarted","Data":"99687f8146d4722d0ad3af4f1b64dcd26a1766157e419a45167490cfc4f7dd68"} May 21 02:14:57.799183 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:57.799159 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zf9gv" event={"ID":"7d77cec2-0f81-4ef3-899e-37cd34ccf281","Type":"ContainerStarted","Data":"f457c1fa8868c9825f3c3fdb184fefc831b49b4d0524c0593ba00840cb22af73"} May 21 02:14:58.089879 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.089788 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-55979f9cfc-ntwxl"] May 21 02:14:58.094084 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.094056 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.104328 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.104297 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55979f9cfc-ntwxl"] May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127287 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-trusted-ca-bundle\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127358 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-oauth-config\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127391 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-config\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127424 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-serving-cert\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127452 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-service-ca\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127491 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-oauth-serving-cert\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.127704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.127519 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7nl\" (UniqueName: \"kubernetes.io/projected/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-kube-api-access-5m7nl\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.228778 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-oauth-serving-cert\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.228837 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7nl\" (UniqueName: \"kubernetes.io/projected/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-kube-api-access-5m7nl\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.228926 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-trusted-ca-bundle\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.228985 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-oauth-config\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.229014 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-config\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.229044 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-serving-cert\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.229073 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-service-ca\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.230506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-trusted-ca-bundle\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.231802 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.231032 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-oauth-serving-cert\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.233231 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.233069 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-service-ca\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.233350 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.233261 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-config\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.237122 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.237089 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-oauth-config\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.239596 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.239552 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-console-serving-cert\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.244280 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.244255 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7nl\" (UniqueName: \"kubernetes.io/projected/cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c-kube-api-access-5m7nl\") pod \"console-55979f9cfc-ntwxl\" (UID: \"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c\") " pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.413168 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.412609 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:14:58.627343 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.627312 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55979f9cfc-ntwxl"] May 21 02:14:58.629871 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:14:58.629824 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcbc6a5_7806_44c6_a9c0_8db6b62cfa5c.slice/crio-363c59f9243cd9d9766d7e6c0cfc8f2c990937f565844c133d12d17eb8748ca3 WatchSource:0}: Error finding container 363c59f9243cd9d9766d7e6c0cfc8f2c990937f565844c133d12d17eb8748ca3: Status 404 returned error can't find the container with id 363c59f9243cd9d9766d7e6c0cfc8f2c990937f565844c133d12d17eb8748ca3 May 21 02:14:58.813407 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.813357 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55979f9cfc-ntwxl" event={"ID":"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c","Type":"ContainerStarted","Data":"9541e60bdc9eb87b8f10a178d2ca8149eef16421a4de3d9d6dac660cdb1303ab"} May 21 02:14:58.813890 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.813415 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55979f9cfc-ntwxl" event={"ID":"cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c","Type":"ContainerStarted","Data":"363c59f9243cd9d9766d7e6c0cfc8f2c990937f565844c133d12d17eb8748ca3"} May 21 02:14:58.836094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:14:58.836030 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-55979f9cfc-ntwxl" podStartSLOduration=0.836008433 podStartE2EDuration="836.008433ms" podCreationTimestamp="2026-05-21 02:14:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:14:58.83477005 +0000 UTC m=+552.598002586" watchObservedRunningTime="2026-05-21 02:14:58.836008433 +0000 UTC m=+552.599240819" May 21 02:15:01.828068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:01.828029 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" event={"ID":"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c","Type":"ContainerStarted","Data":"b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79"} May 21 02:15:01.829336 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:01.829311 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zf9gv" event={"ID":"7d77cec2-0f81-4ef3-899e-37cd34ccf281","Type":"ContainerStarted","Data":"8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9"} May 21 02:15:01.844785 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:01.844713 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" podStartSLOduration=2.097549368 podStartE2EDuration="5.844695275s" podCreationTimestamp="2026-05-21 02:14:56 +0000 UTC" firstStartedPulling="2026-05-21 02:14:57.207532147 +0000 UTC m=+550.970764510" lastFinishedPulling="2026-05-21 02:15:00.954678051 +0000 UTC m=+554.717910417" observedRunningTime="2026-05-21 02:15:01.843241235 +0000 UTC m=+555.606473620" watchObservedRunningTime="2026-05-21 02:15:01.844695275 +0000 UTC m=+555.607927661" May 21 02:15:01.859997 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:01.859944 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-zf9gv" podStartSLOduration=2.318348678 podStartE2EDuration="5.85992609s" podCreationTimestamp="2026-05-21 02:14:56 +0000 UTC" firstStartedPulling="2026-05-21 02:14:57.401640827 +0000 UTC m=+551.164873191" lastFinishedPulling="2026-05-21 02:15:00.943218237 +0000 UTC m=+554.706450603" observedRunningTime="2026-05-21 02:15:01.857028875 +0000 UTC m=+555.620261261" watchObservedRunningTime="2026-05-21 02:15:01.85992609 +0000 UTC m=+555.623158476" May 21 02:15:01.885639 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:01.885603 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-52pzf"] May 21 02:15:03.836687 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:03.836646 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" podUID="edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" containerName="authorino" containerID="cri-o://b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79" gracePeriod=30 May 21 02:15:04.083389 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.083367 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:15:04.190912 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.190831 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg6xf\" (UniqueName: \"kubernetes.io/projected/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c-kube-api-access-cg6xf\") pod \"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c\" (UID: \"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c\") " May 21 02:15:04.192936 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.192910 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c-kube-api-access-cg6xf" (OuterVolumeSpecName: "kube-api-access-cg6xf") pod "edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" (UID: "edc8c7a8-ae8a-4ea7-9f55-d2680a53487c"). InnerVolumeSpecName "kube-api-access-cg6xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:04.291448 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.291410 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg6xf\" (UniqueName: \"kubernetes.io/projected/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c-kube-api-access-cg6xf\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:04.841883 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.841842 2548 generic.go:358] "Generic (PLEG): container finished" podID="edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" containerID="b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79" exitCode=0 May 21 02:15:04.842359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.841891 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" May 21 02:15:04.842359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.841906 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" event={"ID":"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c","Type":"ContainerDied","Data":"b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79"} May 21 02:15:04.842359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.841939 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-52pzf" event={"ID":"edc8c7a8-ae8a-4ea7-9f55-d2680a53487c","Type":"ContainerDied","Data":"99687f8146d4722d0ad3af4f1b64dcd26a1766157e419a45167490cfc4f7dd68"} May 21 02:15:04.842359 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.841956 2548 scope.go:117] "RemoveContainer" containerID="b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79" May 21 02:15:04.851555 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.851537 2548 scope.go:117] "RemoveContainer" containerID="b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79" May 21 02:15:04.851833 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:15:04.851792 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79\": container with ID starting with b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79 not found: ID does not exist" containerID="b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79" May 21 02:15:04.851833 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.851823 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79"} err="failed to get container status \"b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79\": rpc error: code = NotFound desc = could not find container \"b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79\": container with ID starting with b04804df5a54a4f2650762c8592b294b2c225e35ca77da9da8a6c56866b62e79 not found: ID does not exist" May 21 02:15:04.866165 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.866140 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-52pzf"] May 21 02:15:04.869832 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:04.869809 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-52pzf"] May 21 02:15:06.855297 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:06.855266 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" path="/var/lib/kubelet/pods/edc8c7a8-ae8a-4ea7-9f55-d2680a53487c/volumes" May 21 02:15:08.413155 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:08.413123 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:15:08.413155 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:08.413164 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:15:08.417868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:08.417844 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:15:08.861393 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:08.861365 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55979f9cfc-ntwxl" May 21 02:15:08.908137 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:08.908102 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c449f4b96-2ck5q"] May 21 02:15:29.379449 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.379402 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kk8dt"] May 21 02:15:29.380037 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.380018 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" containerName="authorino" May 21 02:15:29.380115 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.380040 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" containerName="authorino" May 21 02:15:29.380174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.380138 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="edc8c7a8-ae8a-4ea7-9f55-d2680a53487c" containerName="authorino" May 21 02:15:29.384625 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.384605 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:29.389382 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.389357 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kk8dt"] May 21 02:15:29.527190 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.527153 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f522d\" (UniqueName: \"kubernetes.io/projected/2dc9865e-dc03-4606-829b-afb32dfb52a7-kube-api-access-f522d\") pod \"authorino-8b475cf9f-kk8dt\" (UID: \"2dc9865e-dc03-4606-829b-afb32dfb52a7\") " pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:29.543424 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.543387 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kk8dt"] May 21 02:15:29.543686 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:15:29.543665 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f522d], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-kk8dt" podUID="2dc9865e-dc03-4606-829b-afb32dfb52a7" May 21 02:15:29.570434 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.570399 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-skdpq"] May 21 02:15:29.574030 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.574007 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.576643 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.576620 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 02:15:29.579390 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.579367 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-skdpq"] May 21 02:15:29.613552 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.613520 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-skdpq"] May 21 02:15:29.613838 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:15:29.613816 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hkd7x tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-hkd7x tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-skdpq" podUID="c5977d1b-9f00-47e9-8bbc-8700ee3b792e" May 21 02:15:29.628193 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.628167 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f522d\" (UniqueName: \"kubernetes.io/projected/2dc9865e-dc03-4606-829b-afb32dfb52a7-kube-api-access-f522d\") pod \"authorino-8b475cf9f-kk8dt\" (UID: \"2dc9865e-dc03-4606-829b-afb32dfb52a7\") " pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:29.639594 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.639526 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74486857cc-hsm4m"] May 21 02:15:29.640197 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.640174 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f522d\" (UniqueName: \"kubernetes.io/projected/2dc9865e-dc03-4606-829b-afb32dfb52a7-kube-api-access-f522d\") pod \"authorino-8b475cf9f-kk8dt\" (UID: \"2dc9865e-dc03-4606-829b-afb32dfb52a7\") " pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:29.643661 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.643642 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.649419 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.649392 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74486857cc-hsm4m"] May 21 02:15:29.729104 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.729065 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpn2p\" (UniqueName: \"kubernetes.io/projected/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-kube-api-access-hpn2p\") pod \"authorino-74486857cc-hsm4m\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.729281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.729109 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkd7x\" (UniqueName: \"kubernetes.io/projected/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-kube-api-access-hkd7x\") pod \"authorino-56fdd757f5-skdpq\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.729281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.729197 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-tls-cert\") pod \"authorino-56fdd757f5-skdpq\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.729281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.729239 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-tls-cert\") pod \"authorino-74486857cc-hsm4m\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.830575 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.830518 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-tls-cert\") pod \"authorino-56fdd757f5-skdpq\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.830805 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.830683 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-tls-cert\") pod \"authorino-74486857cc-hsm4m\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.830864 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.830825 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpn2p\" (UniqueName: \"kubernetes.io/projected/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-kube-api-access-hpn2p\") pod \"authorino-74486857cc-hsm4m\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.830864 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.830855 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkd7x\" (UniqueName: \"kubernetes.io/projected/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-kube-api-access-hkd7x\") pod \"authorino-56fdd757f5-skdpq\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.833023 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.832995 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-tls-cert\") pod \"authorino-56fdd757f5-skdpq\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.833150 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.833004 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-tls-cert\") pod \"authorino-74486857cc-hsm4m\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.838156 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.838138 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpn2p\" (UniqueName: \"kubernetes.io/projected/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-kube-api-access-hpn2p\") pod \"authorino-74486857cc-hsm4m\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:29.838281 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.838261 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkd7x\" (UniqueName: \"kubernetes.io/projected/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-kube-api-access-hkd7x\") pod \"authorino-56fdd757f5-skdpq\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.943094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.943006 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.943094 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.943006 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:29.948525 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.948504 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:29.951817 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.951797 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:29.957800 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:29.957784 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:15:30.033265 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.033235 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkd7x\" (UniqueName: \"kubernetes.io/projected/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-kube-api-access-hkd7x\") pod \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " May 21 02:15:30.033444 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.033275 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-tls-cert\") pod \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\" (UID: \"c5977d1b-9f00-47e9-8bbc-8700ee3b792e\") " May 21 02:15:30.033444 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.033313 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f522d\" (UniqueName: \"kubernetes.io/projected/2dc9865e-dc03-4606-829b-afb32dfb52a7-kube-api-access-f522d\") pod \"2dc9865e-dc03-4606-829b-afb32dfb52a7\" (UID: \"2dc9865e-dc03-4606-829b-afb32dfb52a7\") " May 21 02:15:30.035431 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.035397 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c5977d1b-9f00-47e9-8bbc-8700ee3b792e" (UID: "c5977d1b-9f00-47e9-8bbc-8700ee3b792e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:15:30.035431 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.035413 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc9865e-dc03-4606-829b-afb32dfb52a7-kube-api-access-f522d" (OuterVolumeSpecName: "kube-api-access-f522d") pod "2dc9865e-dc03-4606-829b-afb32dfb52a7" (UID: "2dc9865e-dc03-4606-829b-afb32dfb52a7"). InnerVolumeSpecName "kube-api-access-f522d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:30.035582 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.035462 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-kube-api-access-hkd7x" (OuterVolumeSpecName: "kube-api-access-hkd7x") pod "c5977d1b-9f00-47e9-8bbc-8700ee3b792e" (UID: "c5977d1b-9f00-47e9-8bbc-8700ee3b792e"). InnerVolumeSpecName "kube-api-access-hkd7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:30.088783 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.088740 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74486857cc-hsm4m"] May 21 02:15:30.090953 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:15:30.090923 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f0559c5_34b9_456f_b9e8_8fc4c06e7df4.slice/crio-77a7ac0ceb66e4cdd8b6cdb0a8a2a0ae9322df63d3d3a8d4e2d604dad90788bf WatchSource:0}: Error finding container 77a7ac0ceb66e4cdd8b6cdb0a8a2a0ae9322df63d3d3a8d4e2d604dad90788bf: Status 404 returned error can't find the container with id 77a7ac0ceb66e4cdd8b6cdb0a8a2a0ae9322df63d3d3a8d4e2d604dad90788bf May 21 02:15:30.134722 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.134690 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f522d\" (UniqueName: \"kubernetes.io/projected/2dc9865e-dc03-4606-829b-afb32dfb52a7-kube-api-access-f522d\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:30.134722 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.134719 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkd7x\" (UniqueName: \"kubernetes.io/projected/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-kube-api-access-hkd7x\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:30.134947 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.134731 2548 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5977d1b-9f00-47e9-8bbc-8700ee3b792e-tls-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:30.948144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.948050 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74486857cc-hsm4m" event={"ID":"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4","Type":"ContainerStarted","Data":"e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b"} May 21 02:15:30.948144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.948097 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74486857cc-hsm4m" event={"ID":"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4","Type":"ContainerStarted","Data":"77a7ac0ceb66e4cdd8b6cdb0a8a2a0ae9322df63d3d3a8d4e2d604dad90788bf"} May 21 02:15:30.948144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.948076 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-skdpq" May 21 02:15:30.948144 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.948067 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kk8dt" May 21 02:15:30.964172 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.964125 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-74486857cc-hsm4m" podStartSLOduration=1.66824432 podStartE2EDuration="1.96411098s" podCreationTimestamp="2026-05-21 02:15:29 +0000 UTC" firstStartedPulling="2026-05-21 02:15:30.092113969 +0000 UTC m=+583.855346332" lastFinishedPulling="2026-05-21 02:15:30.387980626 +0000 UTC m=+584.151212992" observedRunningTime="2026-05-21 02:15:30.961903121 +0000 UTC m=+584.725135512" watchObservedRunningTime="2026-05-21 02:15:30.96411098 +0000 UTC m=+584.727343364" May 21 02:15:30.986174 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.986142 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kk8dt"] May 21 02:15:30.991995 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.991965 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zf9gv"] May 21 02:15:30.992204 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.992181 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-zf9gv" podUID="7d77cec2-0f81-4ef3-899e-37cd34ccf281" containerName="authorino" containerID="cri-o://8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9" gracePeriod=30 May 21 02:15:30.994823 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:30.994798 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kk8dt"] May 21 02:15:31.021297 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.021264 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-skdpq"] May 21 02:15:31.023773 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.023726 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-skdpq"] May 21 02:15:31.244562 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.244541 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:15:31.344792 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.344765 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz7mc\" (UniqueName: \"kubernetes.io/projected/7d77cec2-0f81-4ef3-899e-37cd34ccf281-kube-api-access-qz7mc\") pod \"7d77cec2-0f81-4ef3-899e-37cd34ccf281\" (UID: \"7d77cec2-0f81-4ef3-899e-37cd34ccf281\") " May 21 02:15:31.346849 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.346823 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d77cec2-0f81-4ef3-899e-37cd34ccf281-kube-api-access-qz7mc" (OuterVolumeSpecName: "kube-api-access-qz7mc") pod "7d77cec2-0f81-4ef3-899e-37cd34ccf281" (UID: "7d77cec2-0f81-4ef3-899e-37cd34ccf281"). InnerVolumeSpecName "kube-api-access-qz7mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:31.445763 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.445702 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz7mc\" (UniqueName: \"kubernetes.io/projected/7d77cec2-0f81-4ef3-899e-37cd34ccf281-kube-api-access-qz7mc\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:31.953112 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.953067 2548 generic.go:358] "Generic (PLEG): container finished" podID="7d77cec2-0f81-4ef3-899e-37cd34ccf281" containerID="8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9" exitCode=0 May 21 02:15:31.953511 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.953126 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zf9gv" May 21 02:15:31.953511 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.953148 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zf9gv" event={"ID":"7d77cec2-0f81-4ef3-899e-37cd34ccf281","Type":"ContainerDied","Data":"8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9"} May 21 02:15:31.953511 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.953181 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zf9gv" event={"ID":"7d77cec2-0f81-4ef3-899e-37cd34ccf281","Type":"ContainerDied","Data":"f457c1fa8868c9825f3c3fdb184fefc831b49b4d0524c0593ba00840cb22af73"} May 21 02:15:31.953511 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.953197 2548 scope.go:117] "RemoveContainer" containerID="8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9" May 21 02:15:31.961834 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.961817 2548 scope.go:117] "RemoveContainer" containerID="8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9" May 21 02:15:31.962099 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:15:31.962081 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9\": container with ID starting with 8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9 not found: ID does not exist" containerID="8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9" May 21 02:15:31.962142 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.962110 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9"} err="failed to get container status \"8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9\": rpc error: code = NotFound desc = could not find container \"8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9\": container with ID starting with 8fa51c45adafe7854250a45c0144068f3463977dd81fb8f345d62952b0c46ae9 not found: ID does not exist" May 21 02:15:31.976771 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.974314 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zf9gv"] May 21 02:15:31.981794 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:31.981770 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-zf9gv"] May 21 02:15:32.855734 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:32.855687 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dc9865e-dc03-4606-829b-afb32dfb52a7" path="/var/lib/kubelet/pods/2dc9865e-dc03-4606-829b-afb32dfb52a7/volumes" May 21 02:15:32.856040 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:32.856021 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d77cec2-0f81-4ef3-899e-37cd34ccf281" path="/var/lib/kubelet/pods/7d77cec2-0f81-4ef3-899e-37cd34ccf281/volumes" May 21 02:15:32.856422 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:32.856403 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5977d1b-9f00-47e9-8bbc-8700ee3b792e" path="/var/lib/kubelet/pods/c5977d1b-9f00-47e9-8bbc-8700ee3b792e/volumes" May 21 02:15:33.928431 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:33.928343 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c449f4b96-2ck5q" podUID="38d446c2-6848-43eb-a9eb-06153628a00b" containerName="console" containerID="cri-o://1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad" gracePeriod=15 May 21 02:15:34.189612 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.189551 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c449f4b96-2ck5q_38d446c2-6848-43eb-a9eb-06153628a00b/console/0.log" May 21 02:15:34.189612 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.189611 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:15:34.372985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.372950 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-service-ca\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.372985 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.372982 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-trusted-ca-bundle\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.373255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373053 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-serving-cert\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.373255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373078 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-console-config\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.373255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373111 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-oauth-config\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.373255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373201 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-oauth-serving-cert\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.373255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373244 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvqvh\" (UniqueName: \"kubernetes.io/projected/38d446c2-6848-43eb-a9eb-06153628a00b-kube-api-access-wvqvh\") pod \"38d446c2-6848-43eb-a9eb-06153628a00b\" (UID: \"38d446c2-6848-43eb-a9eb-06153628a00b\") " May 21 02:15:34.373534 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373406 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-service-ca" (OuterVolumeSpecName: "service-ca") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:15:34.373592 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373538 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:15:34.373592 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373503 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-console-config" (OuterVolumeSpecName: "console-config") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:15:34.373677 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373608 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.373677 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373626 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.373677 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373625 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 02:15:34.373677 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.373640 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.375351 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.375323 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:15:34.375472 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.375389 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:15:34.375472 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.375404 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d446c2-6848-43eb-a9eb-06153628a00b-kube-api-access-wvqvh" (OuterVolumeSpecName: "kube-api-access-wvqvh") pod "38d446c2-6848-43eb-a9eb-06153628a00b" (UID: "38d446c2-6848-43eb-a9eb-06153628a00b"). InnerVolumeSpecName "kube-api-access-wvqvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:15:34.475068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.475037 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.475068 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.475067 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38d446c2-6848-43eb-a9eb-06153628a00b-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.475264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.475081 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38d446c2-6848-43eb-a9eb-06153628a00b-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.475264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.475090 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvqvh\" (UniqueName: \"kubernetes.io/projected/38d446c2-6848-43eb-a9eb-06153628a00b-kube-api-access-wvqvh\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:15:34.969503 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.969472 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c449f4b96-2ck5q_38d446c2-6848-43eb-a9eb-06153628a00b/console/0.log" May 21 02:15:34.969977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.969520 2548 generic.go:358] "Generic (PLEG): container finished" podID="38d446c2-6848-43eb-a9eb-06153628a00b" containerID="1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad" exitCode=2 May 21 02:15:34.969977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.969584 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c449f4b96-2ck5q" May 21 02:15:34.969977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.969608 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c449f4b96-2ck5q" event={"ID":"38d446c2-6848-43eb-a9eb-06153628a00b","Type":"ContainerDied","Data":"1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad"} May 21 02:15:34.969977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.969643 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c449f4b96-2ck5q" event={"ID":"38d446c2-6848-43eb-a9eb-06153628a00b","Type":"ContainerDied","Data":"14f6f6067348e95dccc1913d07a55ced32a9f1d89a8e1a25be413e7f3f2907a8"} May 21 02:15:34.969977 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.969665 2548 scope.go:117] "RemoveContainer" containerID="1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad" May 21 02:15:34.978517 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.978501 2548 scope.go:117] "RemoveContainer" containerID="1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad" May 21 02:15:34.978790 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:15:34.978764 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad\": container with ID starting with 1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad not found: ID does not exist" containerID="1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad" May 21 02:15:34.978887 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.978795 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad"} err="failed to get container status \"1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad\": rpc error: code = NotFound desc = could not find container \"1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad\": container with ID starting with 1ffc31beb809105b4de17c7d3c9559f4a9c39b536916722c84c19850f75f20ad not found: ID does not exist" May 21 02:15:34.989936 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.989541 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c449f4b96-2ck5q"] May 21 02:15:34.992425 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:34.992402 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c449f4b96-2ck5q"] May 21 02:15:36.854979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:15:36.854946 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d446c2-6848-43eb-a9eb-06153628a00b" path="/var/lib/kubelet/pods/38d446c2-6848-43eb-a9eb-06153628a00b/volumes" May 21 02:16:55.821576 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.821536 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx"] May 21 02:16:55.822187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.822137 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d446c2-6848-43eb-a9eb-06153628a00b" containerName="console" May 21 02:16:55.822187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.822157 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d446c2-6848-43eb-a9eb-06153628a00b" containerName="console" May 21 02:16:55.822187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.822174 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d77cec2-0f81-4ef3-899e-37cd34ccf281" containerName="authorino" May 21 02:16:55.822187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.822182 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d77cec2-0f81-4ef3-899e-37cd34ccf281" containerName="authorino" May 21 02:16:55.822418 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.822271 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d77cec2-0f81-4ef3-899e-37cd34ccf281" containerName="authorino" May 21 02:16:55.822418 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.822293 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="38d446c2-6848-43eb-a9eb-06153628a00b" containerName="console" May 21 02:16:55.824919 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.824898 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:55.827268 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.827250 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 02:16:55.828124 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.828107 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 02:16:55.828249 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.828233 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8cmcx\"" May 21 02:16:55.828321 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.828289 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 02:16:55.835026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.835002 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx"] May 21 02:16:55.909101 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.909058 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:55.909257 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.909113 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6lm\" (UniqueName: \"kubernetes.io/projected/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-kube-api-access-wx6lm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:55.909257 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.909221 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:55.909403 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.909380 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:55.909461 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.909434 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:55.909509 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:55.909477 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.009982 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.009941 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010022 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010047 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010071 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010103 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010187 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010129 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6lm\" (UniqueName: \"kubernetes.io/projected/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-kube-api-access-wx6lm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010478 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010457 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010522 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.010568 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.010506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.012304 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.012285 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.012671 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.012650 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.029196 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.029172 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6lm\" (UniqueName: \"kubernetes.io/projected/e4ab5b80-c2e9-449b-9258-80c4989dd9a3-kube-api-access-wx6lm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx\" (UID: \"e4ab5b80-c2e9-449b-9258-80c4989dd9a3\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.136561 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.136478 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:16:56.269814 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.269787 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx"] May 21 02:16:56.270954 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:16:56.270934 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ab5b80_c2e9_449b_9258_80c4989dd9a3.slice/crio-ae446e14fb1157845ecf93f998e146d79a7c9de77273b93a2496eb752cf8eb3b WatchSource:0}: Error finding container ae446e14fb1157845ecf93f998e146d79a7c9de77273b93a2496eb752cf8eb3b: Status 404 returned error can't find the container with id ae446e14fb1157845ecf93f998e146d79a7c9de77273b93a2496eb752cf8eb3b May 21 02:16:56.272630 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.272609 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:16:56.298445 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:16:56.298409 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" event={"ID":"e4ab5b80-c2e9-449b-9258-80c4989dd9a3","Type":"ContainerStarted","Data":"ae446e14fb1157845ecf93f998e146d79a7c9de77273b93a2496eb752cf8eb3b"} May 21 02:17:02.324505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:02.324467 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" event={"ID":"e4ab5b80-c2e9-449b-9258-80c4989dd9a3","Type":"ContainerStarted","Data":"158e0ffc102fe00df7546dc0c75d8fa46638d928797a06f46be09c27947f940c"} May 21 02:17:07.344866 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:07.344781 2548 generic.go:358] "Generic (PLEG): container finished" podID="e4ab5b80-c2e9-449b-9258-80c4989dd9a3" containerID="158e0ffc102fe00df7546dc0c75d8fa46638d928797a06f46be09c27947f940c" exitCode=0 May 21 02:17:07.344866 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:07.344853 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" event={"ID":"e4ab5b80-c2e9-449b-9258-80c4989dd9a3","Type":"ContainerDied","Data":"158e0ffc102fe00df7546dc0c75d8fa46638d928797a06f46be09c27947f940c"} May 21 02:17:09.354388 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:09.354355 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" event={"ID":"e4ab5b80-c2e9-449b-9258-80c4989dd9a3","Type":"ContainerStarted","Data":"b94a02d05a54ee3faea8d3075dc3fe8a7954dc2149fae9496b45a9542132002f"} May 21 02:17:09.354878 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:09.354582 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:17:09.371831 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:09.371785 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" podStartSLOduration=2.231408802 podStartE2EDuration="14.371772565s" podCreationTimestamp="2026-05-21 02:16:55 +0000 UTC" firstStartedPulling="2026-05-21 02:16:56.272737909 +0000 UTC m=+670.035970272" lastFinishedPulling="2026-05-21 02:17:08.413101657 +0000 UTC m=+682.176334035" observedRunningTime="2026-05-21 02:17:09.370423947 +0000 UTC m=+683.133656331" watchObservedRunningTime="2026-05-21 02:17:09.371772565 +0000 UTC m=+683.135004949" May 21 02:17:20.372535 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:20.372503 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx" May 21 02:17:24.221943 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.221907 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6"] May 21 02:17:24.457299 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.457267 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6"] May 21 02:17:24.457471 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.457403 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.459819 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.459798 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 02:17:24.577526 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.577482 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8l66\" (UniqueName: \"kubernetes.io/projected/13f03d14-cbad-4d5d-995a-34478c44d777-kube-api-access-k8l66\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.577712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.577536 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.577712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.577562 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f03d14-cbad-4d5d-995a-34478c44d777-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.577712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.577584 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.577712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.577611 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.577712 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.577672 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.678698 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.678664 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8l66\" (UniqueName: \"kubernetes.io/projected/13f03d14-cbad-4d5d-995a-34478c44d777-kube-api-access-k8l66\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.678866 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.678718 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.678866 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.678780 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f03d14-cbad-4d5d-995a-34478c44d777-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.678938 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.678904 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.678979 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.678959 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.679023 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.678982 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.679237 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.679213 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.679324 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.679240 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.679427 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.679404 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.681006 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.680989 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f03d14-cbad-4d5d-995a-34478c44d777-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.681173 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.681157 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f03d14-cbad-4d5d-995a-34478c44d777-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.685561 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.685539 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8l66\" (UniqueName: \"kubernetes.io/projected/13f03d14-cbad-4d5d-995a-34478c44d777-kube-api-access-k8l66\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6\" (UID: \"13f03d14-cbad-4d5d-995a-34478c44d777\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.767995 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.767951 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:24.899114 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:24.899086 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6"] May 21 02:17:24.900162 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:17:24.900133 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f03d14_cbad_4d5d_995a_34478c44d777.slice/crio-ea2b927a6647339b627e2f36bb23fca04744f8c1bd80869fcebbaf75c8522710 WatchSource:0}: Error finding container ea2b927a6647339b627e2f36bb23fca04744f8c1bd80869fcebbaf75c8522710: Status 404 returned error can't find the container with id ea2b927a6647339b627e2f36bb23fca04744f8c1bd80869fcebbaf75c8522710 May 21 02:17:25.419946 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:25.419907 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" event={"ID":"13f03d14-cbad-4d5d-995a-34478c44d777","Type":"ContainerStarted","Data":"49472d0ae42400b8406261774e976fde7c340b11678ed828ba1f8faf038b3d42"} May 21 02:17:25.420304 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:25.419952 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" event={"ID":"13f03d14-cbad-4d5d-995a-34478c44d777","Type":"ContainerStarted","Data":"ea2b927a6647339b627e2f36bb23fca04744f8c1bd80869fcebbaf75c8522710"} May 21 02:17:30.441919 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:30.441836 2548 generic.go:358] "Generic (PLEG): container finished" podID="13f03d14-cbad-4d5d-995a-34478c44d777" containerID="49472d0ae42400b8406261774e976fde7c340b11678ed828ba1f8faf038b3d42" exitCode=0 May 21 02:17:30.442322 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:30.441910 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" event={"ID":"13f03d14-cbad-4d5d-995a-34478c44d777","Type":"ContainerDied","Data":"49472d0ae42400b8406261774e976fde7c340b11678ed828ba1f8faf038b3d42"} May 21 02:17:31.446880 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:31.446839 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" event={"ID":"13f03d14-cbad-4d5d-995a-34478c44d777","Type":"ContainerStarted","Data":"17d943d1d8d1ecabc19c18656a148c97ea8db70270e6a2bf6c13abd122e45f6b"} May 21 02:17:31.447265 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:31.447050 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:31.464956 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:31.464910 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" podStartSLOduration=7.237896102 podStartE2EDuration="7.464896594s" podCreationTimestamp="2026-05-21 02:17:24 +0000 UTC" firstStartedPulling="2026-05-21 02:17:30.442527515 +0000 UTC m=+704.205759879" lastFinishedPulling="2026-05-21 02:17:30.669527992 +0000 UTC m=+704.432760371" observedRunningTime="2026-05-21 02:17:31.462926653 +0000 UTC m=+705.226159030" watchObservedRunningTime="2026-05-21 02:17:31.464896594 +0000 UTC m=+705.228128978" May 21 02:17:42.464063 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:42.463977 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6" May 21 02:17:44.785194 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:44.785160 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69fbb697d4-bpn5n"] May 21 02:17:44.788844 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:44.788827 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:44.794884 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:44.794857 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fbb697d4-bpn5n"] May 21 02:17:44.961530 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:44.961494 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6cda68-fed0-44ac-a314-bb5c867cdf68-tls-cert\") pod \"authorino-69fbb697d4-bpn5n\" (UID: \"5c6cda68-fed0-44ac-a314-bb5c867cdf68\") " pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:44.961702 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:44.961547 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr7kf\" (UniqueName: \"kubernetes.io/projected/5c6cda68-fed0-44ac-a314-bb5c867cdf68-kube-api-access-gr7kf\") pod \"authorino-69fbb697d4-bpn5n\" (UID: \"5c6cda68-fed0-44ac-a314-bb5c867cdf68\") " pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:45.062845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.062760 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6cda68-fed0-44ac-a314-bb5c867cdf68-tls-cert\") pod \"authorino-69fbb697d4-bpn5n\" (UID: \"5c6cda68-fed0-44ac-a314-bb5c867cdf68\") " pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:45.062845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.062805 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr7kf\" (UniqueName: \"kubernetes.io/projected/5c6cda68-fed0-44ac-a314-bb5c867cdf68-kube-api-access-gr7kf\") pod \"authorino-69fbb697d4-bpn5n\" (UID: \"5c6cda68-fed0-44ac-a314-bb5c867cdf68\") " pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:45.065133 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.065110 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6cda68-fed0-44ac-a314-bb5c867cdf68-tls-cert\") pod \"authorino-69fbb697d4-bpn5n\" (UID: \"5c6cda68-fed0-44ac-a314-bb5c867cdf68\") " pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:45.070637 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.070616 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr7kf\" (UniqueName: \"kubernetes.io/projected/5c6cda68-fed0-44ac-a314-bb5c867cdf68-kube-api-access-gr7kf\") pod \"authorino-69fbb697d4-bpn5n\" (UID: \"5c6cda68-fed0-44ac-a314-bb5c867cdf68\") " pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:45.099613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.099589 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fbb697d4-bpn5n" May 21 02:17:45.239544 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.239515 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fbb697d4-bpn5n"] May 21 02:17:45.240564 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:17:45.240542 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c6cda68_fed0_44ac_a314_bb5c867cdf68.slice/crio-8716933832fa49a023eda0177518c2d754a0431c8460150a7386726fdf109e16 WatchSource:0}: Error finding container 8716933832fa49a023eda0177518c2d754a0431c8460150a7386726fdf109e16: Status 404 returned error can't find the container with id 8716933832fa49a023eda0177518c2d754a0431c8460150a7386726fdf109e16 May 21 02:17:45.507369 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:45.507332 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fbb697d4-bpn5n" event={"ID":"5c6cda68-fed0-44ac-a314-bb5c867cdf68","Type":"ContainerStarted","Data":"8716933832fa49a023eda0177518c2d754a0431c8460150a7386726fdf109e16"} May 21 02:17:46.513264 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.513226 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fbb697d4-bpn5n" event={"ID":"5c6cda68-fed0-44ac-a314-bb5c867cdf68","Type":"ContainerStarted","Data":"a182959326328fdb03e9116b2c3dde885937729fa4236558bd5091269c2c6aa3"} May 21 02:17:46.530063 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.530015 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-69fbb697d4-bpn5n" podStartSLOduration=2.01306497 podStartE2EDuration="2.530001852s" podCreationTimestamp="2026-05-21 02:17:44 +0000 UTC" firstStartedPulling="2026-05-21 02:17:45.242012075 +0000 UTC m=+719.005244438" lastFinishedPulling="2026-05-21 02:17:45.758948943 +0000 UTC m=+719.522181320" observedRunningTime="2026-05-21 02:17:46.528346852 +0000 UTC m=+720.291579247" watchObservedRunningTime="2026-05-21 02:17:46.530001852 +0000 UTC m=+720.293234236" May 21 02:17:46.555457 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.555424 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74486857cc-hsm4m"] May 21 02:17:46.555660 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.555639 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-74486857cc-hsm4m" podUID="0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" containerName="authorino" containerID="cri-o://e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b" gracePeriod=30 May 21 02:17:46.806091 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.806069 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:17:46.979405 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.979369 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpn2p\" (UniqueName: \"kubernetes.io/projected/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-kube-api-access-hpn2p\") pod \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " May 21 02:17:46.979575 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.979425 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-tls-cert\") pod \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\" (UID: \"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4\") " May 21 02:17:46.981410 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.981375 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-kube-api-access-hpn2p" (OuterVolumeSpecName: "kube-api-access-hpn2p") pod "0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" (UID: "0f0559c5-34b9-456f-b9e8-8fc4c06e7df4"). InnerVolumeSpecName "kube-api-access-hpn2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 02:17:46.993080 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:46.993054 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" (UID: "0f0559c5-34b9-456f-b9e8-8fc4c06e7df4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 02:17:47.080073 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.080048 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpn2p\" (UniqueName: \"kubernetes.io/projected/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-kube-api-access-hpn2p\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:17:47.080190 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.080076 2548 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4-tls-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" May 21 02:17:47.518007 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.517973 2548 generic.go:358] "Generic (PLEG): container finished" podID="0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" containerID="e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b" exitCode=0 May 21 02:17:47.518463 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.518020 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74486857cc-hsm4m" May 21 02:17:47.518463 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.518049 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74486857cc-hsm4m" event={"ID":"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4","Type":"ContainerDied","Data":"e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b"} May 21 02:17:47.518463 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.518080 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74486857cc-hsm4m" event={"ID":"0f0559c5-34b9-456f-b9e8-8fc4c06e7df4","Type":"ContainerDied","Data":"77a7ac0ceb66e4cdd8b6cdb0a8a2a0ae9322df63d3d3a8d4e2d604dad90788bf"} May 21 02:17:47.518463 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.518095 2548 scope.go:117] "RemoveContainer" containerID="e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b" May 21 02:17:47.526765 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.526728 2548 scope.go:117] "RemoveContainer" containerID="e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b" May 21 02:17:47.527030 ip-10-0-139-23 kubenswrapper[2548]: E0521 02:17:47.527011 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b\": container with ID starting with e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b not found: ID does not exist" containerID="e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b" May 21 02:17:47.527098 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.527039 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b"} err="failed to get container status \"e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b\": rpc error: code = NotFound desc = could not find container \"e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b\": container with ID starting with e60f3bfdd515e65d803d01f2bcc31e4887697d2bc4a6fc0654f8a24523eca02b not found: ID does not exist" May 21 02:17:47.538760 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.538719 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74486857cc-hsm4m"] May 21 02:17:47.541613 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:47.541588 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74486857cc-hsm4m"] May 21 02:17:48.855822 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:17:48.855769 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" path="/var/lib/kubelet/pods/0f0559c5-34b9-456f-b9e8-8fc4c06e7df4/volumes" May 21 02:40:06.887626 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:06.887549 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69fbb697d4-bpn5n_5c6cda68-fed0-44ac-a314-bb5c867cdf68/authorino/0.log" May 21 02:40:11.897702 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:11.897660 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784fb9f5c5-565xt_b43c8d26-6106-4acd-9fbd-ab69c2be2374/manager/0.log" May 21 02:40:12.737916 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.737886 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv_72853bc1-0e17-4eee-be1c-c5499d8afff5/util/0.log" May 21 02:40:12.743495 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.743468 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv_72853bc1-0e17-4eee-be1c-c5499d8afff5/pull/0.log" May 21 02:40:12.749159 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.749144 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv_72853bc1-0e17-4eee-be1c-c5499d8afff5/extract/0.log" May 21 02:40:12.850171 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.850133 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf_b3862a22-0e6c-4139-a49d-89c01f227d51/util/0.log" May 21 02:40:12.856208 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.856188 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf_b3862a22-0e6c-4139-a49d-89c01f227d51/pull/0.log" May 21 02:40:12.861909 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.861891 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf_b3862a22-0e6c-4139-a49d-89c01f227d51/extract/0.log" May 21 02:40:12.970907 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.970882 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb_a127a780-4870-448f-bff4-8a71ec228217/util/0.log" May 21 02:40:12.977008 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.976973 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb_a127a780-4870-448f-bff4-8a71ec228217/pull/0.log" May 21 02:40:12.982576 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:12.982550 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb_a127a780-4870-448f-bff4-8a71ec228217/extract/0.log" May 21 02:40:13.089526 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.089459 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph_80e8a110-b2be-43ca-bb00-ec469c3a1e3c/util/0.log" May 21 02:40:13.095143 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.095120 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph_80e8a110-b2be-43ca-bb00-ec469c3a1e3c/pull/0.log" May 21 02:40:13.100557 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.100536 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph_80e8a110-b2be-43ca-bb00-ec469c3a1e3c/extract/0.log" May 21 02:40:13.210730 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.210700 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69fbb697d4-bpn5n_5c6cda68-fed0-44ac-a314-bb5c867cdf68/authorino/0.log" May 21 02:40:13.319927 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.319904 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-j6zmw_ad59926e-7cba-4d01-ae03-4ed0726bb0dc/manager/0.log" May 21 02:40:13.425657 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.425578 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-wzt2q_0c317b68-fb74-4163-b9a6-67ea24d7945f/manager/0.log" May 21 02:40:13.651847 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.651819 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zrcxx_50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9/registry-server/0.log" May 21 02:40:13.992725 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:13.992697 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-56dcr_ca732611-66b0-4eba-9922-a210e49bc384/manager/0.log" May 21 02:40:14.323329 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:14.323259 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bchkvb_b8704348-f4f5-405d-9b1d-e20bf470ae0f/istio-proxy/0.log" May 21 02:40:14.752811 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:14.752782 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-hpnjw_dd448442-20c7-4484-b922-4d68ce05f473/istio-proxy/0.log" May 21 02:40:15.298268 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:15.298236 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6_13f03d14-cbad-4d5d-995a-34478c44d777/storage-initializer/0.log" May 21 02:40:15.306099 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:15.306075 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-vfdl6_13f03d14-cbad-4d5d-995a-34478c44d777/main/0.log" May 21 02:40:15.745890 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:15.745849 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx_e4ab5b80-c2e9-449b-9258-80c4989dd9a3/main/0.log" May 21 02:40:15.751632 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:15.751616 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-2l2hx_e4ab5b80-c2e9-449b-9258-80c4989dd9a3/storage-initializer/0.log" May 21 02:40:22.398044 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:22.398015 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hs9cl_558583ac-402a-4f28-a44d-9d5d39396a24/global-pull-secret-syncer/0.log" May 21 02:40:22.467924 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:22.467898 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bkcns_80ec1771-7722-4148-8418-55065c1a240c/konnectivity-agent/0.log" May 21 02:40:22.555883 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:22.555855 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-23.ec2.internal_c7ed515d91df2f1c4f8db9d070df115a/haproxy/0.log" May 21 02:40:26.338868 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.338838 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv_72853bc1-0e17-4eee-be1c-c5499d8afff5/extract/0.log" May 21 02:40:26.357439 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.357415 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv_72853bc1-0e17-4eee-be1c-c5499d8afff5/util/0.log" May 21 02:40:26.375222 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.375191 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h22zv_72853bc1-0e17-4eee-be1c-c5499d8afff5/pull/0.log" May 21 02:40:26.402077 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.402051 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf_b3862a22-0e6c-4139-a49d-89c01f227d51/extract/0.log" May 21 02:40:26.419690 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.419667 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf_b3862a22-0e6c-4139-a49d-89c01f227d51/util/0.log" May 21 02:40:26.438037 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.438008 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wp2lf_b3862a22-0e6c-4139-a49d-89c01f227d51/pull/0.log" May 21 02:40:26.462080 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.462058 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb_a127a780-4870-448f-bff4-8a71ec228217/extract/0.log" May 21 02:40:26.480438 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.480417 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb_a127a780-4870-448f-bff4-8a71ec228217/util/0.log" May 21 02:40:26.504457 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.504436 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4jfb_a127a780-4870-448f-bff4-8a71ec228217/pull/0.log" May 21 02:40:26.540669 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.540639 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph_80e8a110-b2be-43ca-bb00-ec469c3a1e3c/extract/0.log" May 21 02:40:26.553890 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.553867 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph_80e8a110-b2be-43ca-bb00-ec469c3a1e3c/util/0.log" May 21 02:40:26.572255 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.572226 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12hqph_80e8a110-b2be-43ca-bb00-ec469c3a1e3c/pull/0.log" May 21 02:40:26.904601 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.904559 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69fbb697d4-bpn5n_5c6cda68-fed0-44ac-a314-bb5c867cdf68/authorino/0.log" May 21 02:40:26.929300 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.929268 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-j6zmw_ad59926e-7cba-4d01-ae03-4ed0726bb0dc/manager/0.log" May 21 02:40:26.947067 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:26.947045 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-wzt2q_0c317b68-fb74-4163-b9a6-67ea24d7945f/manager/0.log" May 21 02:40:27.006451 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:27.006425 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zrcxx_50a6fc21-2a06-4846-8ab7-49b4cc6b7fa9/registry-server/0.log" May 21 02:40:27.172493 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:27.172391 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-56dcr_ca732611-66b0-4eba-9922-a210e49bc384/manager/0.log" May 21 02:40:28.641523 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.641496 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xtcpr_bb8aa146-d4b8-48e4-a555-117ea71340c6/kube-state-metrics/0.log" May 21 02:40:28.658869 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.658840 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xtcpr_bb8aa146-d4b8-48e4-a555-117ea71340c6/kube-rbac-proxy-main/0.log" May 21 02:40:28.683451 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.683430 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xtcpr_bb8aa146-d4b8-48e4-a555-117ea71340c6/kube-rbac-proxy-self/0.log" May 21 02:40:28.764356 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.764328 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8cwq_72d3e1d4-7220-4023-bdc2-07a67cfad747/node-exporter/0.log" May 21 02:40:28.791431 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.791351 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8cwq_72d3e1d4-7220-4023-bdc2-07a67cfad747/kube-rbac-proxy/0.log" May 21 02:40:28.811287 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.811267 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8cwq_72d3e1d4-7220-4023-bdc2-07a67cfad747/init-textfile/0.log" May 21 02:40:28.982049 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:28.982019 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-67brb_c464c525-a51d-48b5-8ef4-4304ed6f1902/kube-rbac-proxy-main/0.log" May 21 02:40:29.000429 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.000401 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-67brb_c464c525-a51d-48b5-8ef4-4304ed6f1902/kube-rbac-proxy-self/0.log" May 21 02:40:29.018769 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.018726 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-67brb_c464c525-a51d-48b5-8ef4-4304ed6f1902/openshift-state-metrics/0.log" May 21 02:40:29.198375 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.198297 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gqbv5_7e219106-e1f5-4569-b3b8-0f40c9df9f84/prometheus-operator/0.log" May 21 02:40:29.214559 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.214535 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gqbv5_7e219106-e1f5-4569-b3b8-0f40c9df9f84/kube-rbac-proxy/0.log" May 21 02:40:29.236635 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.236606 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-x9f49_9e94c5b0-62df-4a74-a81e-54a0a2714c96/prometheus-operator-admission-webhook/0.log" May 21 02:40:29.325814 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.325784 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/thanos-query/0.log" May 21 02:40:29.342902 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.342876 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy-web/0.log" May 21 02:40:29.364127 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.364106 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy/0.log" May 21 02:40:29.381707 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.381673 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/prom-label-proxy/0.log" May 21 02:40:29.399064 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.399038 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy-rules/0.log" May 21 02:40:29.416413 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:29.416393 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b67b96fb7-q2bnd_4e04fcda-7372-480e-8e40-6cb9be801659/kube-rbac-proxy-metrics/0.log" May 21 02:40:30.925582 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.925551 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj"] May 21 02:40:30.926147 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.926127 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" containerName="authorino" May 21 02:40:30.926232 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.926151 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" containerName="authorino" May 21 02:40:30.926303 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.926289 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f0559c5-34b9-456f-b9e8-8fc4c06e7df4" containerName="authorino" May 21 02:40:30.929488 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.929469 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:30.931900 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.931882 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khz4\"/\"kube-root-ca.crt\"" May 21 02:40:30.932642 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.932623 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6khz4\"/\"default-dockercfg-dhq48\"" May 21 02:40:30.932704 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.932631 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6khz4\"/\"openshift-service-ca.crt\"" May 21 02:40:30.937396 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:30.937374 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj"] May 21 02:40:31.086942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.086904 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-podres\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.086942 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.086943 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqs2g\" (UniqueName: \"kubernetes.io/projected/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-kube-api-access-tqs2g\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.087167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.086966 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-lib-modules\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.087167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.087028 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-sys\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.087167 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.087089 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-proc\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188329 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188253 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-podres\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188329 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188284 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqs2g\" (UniqueName: \"kubernetes.io/projected/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-kube-api-access-tqs2g\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188329 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188304 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-lib-modules\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188332 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-sys\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188355 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-proc\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188428 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-sys\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188437 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-podres\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188443 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-lib-modules\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.188545 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.188449 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-proc\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.195606 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.195589 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqs2g\" (UniqueName: \"kubernetes.io/projected/abff033c-4878-4c7b-bcef-d3fb7b53e0ad-kube-api-access-tqs2g\") pod \"perf-node-gather-daemonset-p5hqj\" (UID: \"abff033c-4878-4c7b-bcef-d3fb7b53e0ad\") " pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.240373 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.240341 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.370828 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.370663 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj"] May 21 02:40:31.373849 ip-10-0-139-23 kubenswrapper[2548]: W0521 02:40:31.373819 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabff033c_4878_4c7b_bcef_d3fb7b53e0ad.slice/crio-29f449a21ad7a76705d217dfe2223f331a2bf5d47fc1101fc672928e3941b58d WatchSource:0}: Error finding container 29f449a21ad7a76705d217dfe2223f331a2bf5d47fc1101fc672928e3941b58d: Status 404 returned error can't find the container with id 29f449a21ad7a76705d217dfe2223f331a2bf5d47fc1101fc672928e3941b58d May 21 02:40:31.375594 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.375577 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 02:40:31.507975 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.507949 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55979f9cfc-ntwxl_cbcbc6a5-7806-44c6-a9c0-8db6b62cfa5c/console/0.log" May 21 02:40:31.977112 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.977075 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" event={"ID":"abff033c-4878-4c7b-bcef-d3fb7b53e0ad","Type":"ContainerStarted","Data":"c4db67d42d2d168c025d16a0ab9ec21b533c17ae3899a1b228a8332eaf6b970e"} May 21 02:40:31.977503 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.977119 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" event={"ID":"abff033c-4878-4c7b-bcef-d3fb7b53e0ad","Type":"ContainerStarted","Data":"29f449a21ad7a76705d217dfe2223f331a2bf5d47fc1101fc672928e3941b58d"} May 21 02:40:31.977503 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.977198 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:31.992505 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:31.992460 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" podStartSLOduration=1.9924439280000001 podStartE2EDuration="1.992443928s" podCreationTimestamp="2026-05-21 02:40:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:40:31.99061572 +0000 UTC m=+2085.753848106" watchObservedRunningTime="2026-05-21 02:40:31.992443928 +0000 UTC m=+2085.755676344" May 21 02:40:32.009839 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:32.009772 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-l7b8s_74fcbd3b-3537-4505-923b-8d29d6d964ba/volume-data-source-validator/0.log" May 21 02:40:32.860497 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:32.860462 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpkrw_11211a5d-656f-4fc7-bad2-06a89a7a761a/dns/0.log" May 21 02:40:32.877519 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:32.877489 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpkrw_11211a5d-656f-4fc7-bad2-06a89a7a761a/kube-rbac-proxy/0.log" May 21 02:40:32.974235 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:32.974208 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhnnz_9c226802-7713-4756-8df1-ad0e72419838/dns-node-resolver/0.log" May 21 02:40:33.482045 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:33.482013 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7dcj_27df3f90-1575-48ea-93c0-0ea337913b1b/node-ca/0.log" May 21 02:40:34.229492 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:34.229465 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bchkvb_b8704348-f4f5-405d-9b1d-e20bf470ae0f/istio-proxy/0.log" May 21 02:40:34.437032 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:34.436993 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-hpnjw_dd448442-20c7-4484-b922-4d68ce05f473/istio-proxy/0.log" May 21 02:40:35.020170 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:35.020143 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sh86t_ca558918-82a6-4677-9d2b-05304be9cf29/serve-healthcheck-canary/0.log" May 21 02:40:35.445863 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:35.445730 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-4f554_04506638-714a-4d83-8197-57a6d6e7f667/insights-operator/0.log" May 21 02:40:35.449949 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:35.449924 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-4f554_04506638-714a-4d83-8197-57a6d6e7f667/insights-operator/1.log" May 21 02:40:35.524252 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:35.524223 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8qrq_8d492a1c-0251-4404-b74b-68e09af214d8/kube-rbac-proxy/0.log" May 21 02:40:35.542832 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:35.542807 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8qrq_8d492a1c-0251-4404-b74b-68e09af214d8/exporter/0.log" May 21 02:40:35.560696 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:35.560670 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8qrq_8d492a1c-0251-4404-b74b-68e09af214d8/extractor/0.log" May 21 02:40:37.611127 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:37.611096 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784fb9f5c5-565xt_b43c8d26-6106-4acd-9fbd-ab69c2be2374/manager/0.log" May 21 02:40:37.989860 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:37.989835 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6khz4/perf-node-gather-daemonset-p5hqj" May 21 02:40:38.708078 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:38.708047 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c674d5855-4cllx_30e65342-dbb2-4922-a957-5184d93bb004/manager/0.log" May 21 02:40:43.008212 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:43.008184 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-grlxg_a7d9321d-d81f-428f-8cc3-2664b71bb63f/migrator/0.log" May 21 02:40:43.024637 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:43.024613 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-grlxg_a7d9321d-d81f-428f-8cc3-2664b71bb63f/graceful-termination/0.log" May 21 02:40:44.298557 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.298525 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-62dvf_40151206-c9ef-45d8-bfd7-deacc5ac40a3/kube-multus/0.log" May 21 02:40:44.341210 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.341185 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/kube-multus-additional-cni-plugins/0.log" May 21 02:40:44.358104 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.358081 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/egress-router-binary-copy/0.log" May 21 02:40:44.376090 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.376066 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/cni-plugins/0.log" May 21 02:40:44.396983 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.396962 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/bond-cni-plugin/0.log" May 21 02:40:44.413813 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.413792 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/routeoverride-cni/0.log" May 21 02:40:44.430721 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.430698 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/whereabouts-cni-bincopy/0.log" May 21 02:40:44.447380 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.447358 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dkl9s_c8e9e6b7-2258-4399-bb6b-a294e2ebb41b/whereabouts-cni/0.log" May 21 02:40:44.792845 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.792791 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j4nwr_8dc202d3-7440-4df8-96f2-09c3248bcacb/network-metrics-daemon/0.log" May 21 02:40:44.807337 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:44.807312 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j4nwr_8dc202d3-7440-4df8-96f2-09c3248bcacb/kube-rbac-proxy/0.log" May 21 02:40:45.620292 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.620250 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/ovn-controller/0.log" May 21 02:40:45.653516 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.653488 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/ovn-acl-logging/0.log" May 21 02:40:45.676008 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.675977 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/kube-rbac-proxy-node/0.log" May 21 02:40:45.696081 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.696051 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/kube-rbac-proxy-ovn-metrics/0.log" May 21 02:40:45.709934 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.709889 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/northd/0.log" May 21 02:40:45.727422 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.727400 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/nbdb/0.log" May 21 02:40:45.744214 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.744192 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/sbdb/0.log" May 21 02:40:45.908496 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:45.908419 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mwvl_5dd2d2ff-9092-41fe-8ca2-aa701ac618ca/ovnkube-controller/0.log" May 21 02:40:47.406998 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:47.406967 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-dm2wx_3cdfa60d-e5d1-4303-86a3-f9638ff6a2eb/check-endpoints/0.log" May 21 02:40:47.464026 ip-10-0-139-23 kubenswrapper[2548]: I0521 02:40:47.463987 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wltsh_c0e3a89e-cc1c-40b8-85a3-144b8c6e6f3b/network-check-target-container/0.log"